selenium - How to bypass being rate limited ..HTML Error 1015 using Python

Question

So i have created an automation bot to do some stuff for me on the internet .. Using Selenium Python..After long and grooling coding sessions ..days and nights of working on this project i have finally completed it ...Only to be randomly greeted with a Error 1015 "You are being rate limited".

I understand this is to prevent DDOS attacks. But it is a major blow.

I have contacted the website to resolve the matter but to no avail ..But the third party security software they use says that they the website can grant my ip exclusion of rate limiting.

So i was wondering is there any other way to bypass this ..maybe from a coding perspective ... I don't think stuff like clearing cookies will resolve anything ..or will it as it is my specific ip address that they are blocking

Note: The TofC of the website i am running my bot on doesn't say you cant use automation software on it ..but it doesn't say you cant either.

I don't mind coding some more to prevent random access denials ..that i think last for 24 hours which can be detrimental as the final stage of this build is to have my program run daily for long periods of times.

Do you think i could communicate with the third party security to ask them to ask the website to grant me access ..I have already tried resolving the matter with the website. All they said was that A. On there side it says i am fine B. The problem is most likely on my side .."Maybe some malicious software is trying to access our website" which .. malicious no but a bot yes. That's what made me think maybe it would be better if i resolved the matter myself.

Do you think i may have to implement wait times between processes or something. Im stuck.

Thanks for any help. And its a single bot!

Answer 1

I see some possibilities for you here:

• Introduce wait time between requests to the site
• Reduce the requests you make
• Extend your bot to detect when it hits the limit and change your ip address (e.g. by restarting you router)

The last one is the least preferable I would assume and also the most time consuming one.