Access to javascript variable with BeautifulSoup

Question

How can I access a javascript variable with BeautifulSoup? I know the name of the variable

The variable is defined in a script tag:

<script>
    var variable_name = value;
</script>

For example, in the browser console I write window.variable_name and I get the value. How can I get an equivalent in Beautiful Soup?

Since you said that the "variable is defined into a script tag in the page", you can use bs4 to get the <script> tag content and then proccess the whole string to extract it's value. I'm not 100% sure this method will work because you haven't posted the url.. But in any case, take a look at this topic. — dot.Py
– dot.Py, Commented Apr 11, 2017 at 16:53
hi did you manage to solve your problem? I have similar issue and solved finding start and end of variable value but ideally would like to call the var name to make it more relaible.. — Je Je
– Je Je, Commented Aug 15, 2020 at 15:54
Hi @NonoLondon, I just extract the text between var variable_name and ; — Giancarlo Ventura
– Giancarlo Ventura, Commented Aug 22, 2020 at 19:39

Community · Accepted Answer · 2017-05-23 12:10:24Z

1

You can't. BeautifulSoup is just a parser for DOM elements, it doesn't evaluate any code inside the page.

You need to "run" the page and access it while it's still "on", using, for example, Selenium, as explained in this post

edited May 23, 2017 at 12:10

CommunityBot

11 silver badge

answered Apr 11, 2017 at 16:39

Thiago Cardoso

5427 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Giancarlo Ventura Over a year ago

The variable is defined into a script tag in the page. I edited the question

Thiago Cardoso Over a year ago

Still, are you sure that is BeautifulSoup what you wanted, because what you will get is a text representation of variable's content if you manage to do that, what maybe won't work for you if the variable holds an object, for example.

Collectives™ on Stack Overflow

Access to javascript variable with BeautifulSoup

1 Answer 1

2 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related