Powershell Web Data Fetching

Question

I am not sure what I am doing wrong. I am trying to fetch the data from URL below.

But I am not getting anything in return using the code below.

What I want to fetch (34)

Powershell Code

$downloadURL     = 'https://example.html'
$downloadRequest = Invoke-WebRequest -Uri $downloadURL

Result
Data not in the output code from Powershell

i would help but I cant pull up the site in its entirety, could be my proxy. Have you tried using the Inspect feature in windows to see which tag that number falls under? — ShanayL
– ShanayL, Commented Nov 13, 2017 at 19:36

matt9 · Accepted Answer · 2017-11-18 01:38:42Z

1

The page is dynamically created with JavaScript. It is hard to get the data by using Invoke-WebRequest cmdlet. Instead of that, try to use Internet Explorer COM object like this:

$url = 'https://example.com'
$ie = New-Object -ComObject InternetExplorer.Application
$ie.Visible = $false
$ie.Navigate2($url)
while($ie.ReadyState -ne 4) { Start-Sleep 1 }
$ie.document.body.getElementsByClassName('example-class-name')::outerHTML
$ie.document.body.getElementsByClassName('example-class-name')::textContent

For more information, see this article.

edited Nov 18, 2017 at 1:38

answered Nov 15, 2017 at 12:03

matt9

7035 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user206168 Over a year ago

Thanks a lot for that info... I am getting this error..

+ $ie.document.body.getElementsByClassName('il-customers-affected-value menu-info- ... + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~     + CategoryInfo          : InvalidOperation: (:) [], RuntimeException     + FullyQualifiedErrorId : MethodNotFound

matt9 Over a year ago

Try to check which method is MethodNotFound by executing $ie | Get-Member, $ie.document | Get-Member, and $ie.document.body | Get-Member.

Collectives™ on Stack Overflow

Powershell Web Data Fetching

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related