Why do the same requests result in different status codes 200 vs. 429 on two machines?

Question

Here is my script:

import requests, os

ips = ['158.46.169.208','158.46.169.252','158.46.169.76','158.46.171.23','158.46.172.217','158.46.172.55','158.46.172.98','158.46.173.104']
headers =  {"User-Agent": "Edg/90.0.818.56"}

os.system("python3 --version") #On Windows it changes to os.system("python --version")

for i in ips:
    pr = {'http':"http://"+"abcd-"+i+':[email protected]:22225','https':'https://'+"abcd-"+i+':[email protected]:22225'}
    res1 = requests.get("https://www.google.com/search?q=butter",headers=headers, proxies= pr)
    print(requests.get("https://www.httpbin.org/ip",proxies = pr,headers=headers).text)
    print(res1.status_code)

Output on Windows 10:

Python 3.8.2
{
  "origin": "158.46.169.208"
}

200
{
  "origin": "158.46.169.252"
}

429
{
  "origin": "158.46.169.76"
}

200
{
  "origin": "158.46.171.23"
}

200
{
  "origin": "158.46.172.217"
}

200
{
  "origin": "158.46.172.55"
}

200
{
  "origin": "158.46.172.98"
}

Output on Ubuntu 18.04:

Python 3.8.0
{
  "origin": "158.46.169.208"
}

429
{
  "origin": "158.46.169.252"
}

429
{
  "origin": "158.46.169.76"
}

429
{
  "origin": "158.46.171.23"
}

429
{
  "origin": "158.46.172.217"
}

429
{
  "origin": "158.46.172.55"
}

429
{
  "origin": "158.46.172.98"
}

429
{
  "origin": "158.46.173.104"
}

429

No matter how many times I run the script (even at the same time on two machines), the outputs remain always the same.

I am unable to understand why it blocks the requests on the Ubuntu. And at the same time, it allows the same requests from windows machine while using the same proxy.

I know 429 error means too many requests but then why it gets successful all the time I run on the Windows machine?

EDIT: I have a dual boot laptop, so I logged in to Ubuntu 18.04 on my laptop on which I have windows too. And it seems to work fine here. Same behavior as of Windows. But still it fails when I run it on my server having Ubuntu 18.04 and again everything is same as above.

Does it have to do with headers = {"User-Agent": "Edg/90.0.818.56"}? Does Edg mean "Edge" which is a Windows browser and the server doesn't like it when this comes from a Linux machine? — mkrieger1
– mkrieger1, Commented May 18, 2021 at 8:42
@mkrieger1 Tried changing it to Firefox/88.0 but no effect. — Darshan
– Darshan, Commented May 18, 2021 at 9:42
Have you checked this question ? stackoverflow.com/questions/22786068/…. — Skaddd
– Skaddd, Commented May 18, 2021 at 10:16
Does this answer your question? How to avoid HTTP error 429 (Too Many Requests) python — Dima Tisnek
– Dima Tisnek, Commented Jun 9, 2021 at 4:41

Dominique · Accepted Answer · 2021-05-18 10:56:54Z

0

You need to understand the meaning of HTTP response 200 (HTTP OK) and 429 (Too many requests), as explained in this Wikipedia article.

As you can see, the problem seems not to be due to your program, but to the machine you're working with, who seems to be launching too many requests (at least that's how the server understands it).

In short, you are dealing with a network related issue, you might consider talking about this issue with your network administrator.

answered May 18, 2021 at 10:56

Dominique

17.7k20 gold badges81 silver badges161 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

mkrieger1 Over a year ago

But they are launching the same number of requests in both cases?

Darshan Over a year ago

@mkrieger1 Updated the question please have a look.

scagbackbone Over a year ago

do your first run it on windows and then via ubuntu? try other way around... as it may be that each of the ips have some rate limit in place - possibly allowing only one request for minute (but that is just a wild guess)

haritz · Accepted Answer · 2023-01-10 22:46:00Z

You need to include Accept-Encoding to your headers.

import requests, os
ips = ['158.46.169.208','158.46.169.252','158.46.169.76','158.46.171.23','158.46.172.217','158.46.172.55','158.46.172.98','158.46.173.104']
headers =  {"User-Agent": "Edg/90.0.818.56", "Accept-Handling": "gzip, deflate, br"}

os.system("python3 --version") #On Windows it changes to os.system("python --version")

for i in ips:
    pr = {'http':"http://"+"abcd-"+i+':[email protected]:22225','https':'https://'+"abcd-"+i+':[email protected]:22225'}
    res1 = requests.get("https://www.google.com/search?q=butter",headers=headers, proxies= pr)
    print(requests.get("https://www.httpbin.org/ip",proxies = pr,headers=headers).text)
    print(res1.status_code)

Collectives™ on Stack Overflow

Why do the same requests result in different status codes 200 vs. 429 on two machines?

2 Answers 2

3 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related