Using cURL to get script content [duplicate]

Question

I'm using cURL to access a site. The problem is that content that I need to grab is generated by a script as:

function Button(){
...
document.getElementById("out").innerHTML = name;
}

<p id="out"></p>

With cURL, I have the code of the page but not the content. I'm using this config:

  $curl = curl_init();
curl_setopt($curl, CURLOPT_URL, $url);
curl_setopt($curl, CURLOPT_RETURNTRANSFER, 1);
curl_setopt($curl, CURLOPT_REFERER, $referer);
curl_setopt($curl, CURLOPT_COOKIEFILE, $cookiefile);
$redirects=5000;
$data = curl_redirect_exec($curl,$redirects);
curl_close($curl);

I could get the content generate by the script.

read this docs.seleniumhq.org

ashkufaraz
– ashkufaraz

2015-12-13 15:02:55 +00:00
Commented Dec 13, 2015 at 15:02 — ashkufaraz
– ashkufaraz, Commented Dec 13, 2015 at 15:02

vnay92 · Accepted Answer · 2015-12-13 15:02:21Z

1

You cannot get data rendered in JS from PHP CURL. What you need is a headless browser, something that runs client side scripts like Phantom.JS or Casper.JS which have the capability of running Client-Side JavaScript.

answered Dec 13, 2015 at 15:02

vnay92

3181 gold badge4 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Using cURL to get script content [duplicate]

1 Answer 1

Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Linked

Related