![]() ![]() So its generally a good diea to pick a safe range, such as is listed above, and stay with it. There is no way to know this for certain, google gives no codes that indicate anything, its merely a matter of trial and error. ![]() So if the person that had the proxies before you got them banned a lot then you will have to use more proxies or add a delay. Such things as the more often a proxy is banned the quicker it is banned in the future, and the longer it is banend for. However there is no hard fast rule as there are many factors that cant' be predicted/known. If you were searching for something like "inurl:contact cloud" and you had 100 proxies you could try using 2 connections, but if you only had say 10 proxie syou might need a 10-20 second delay. So if you are searching for words like "cloud" and yo uahve 60 proxies, then you could try using 2 connections. So if you don't have enough proxies to do that, then you can use the detailed harvester and use a delay. The concept here is that the ips are used slow enough that it doens't trigger a ban. If you don't have that many proxies then you can use the detailed harvester and add a delay. For advanced operator scraping its recommended to use 1 connection for every 30-50+ proxies. ![]() As a general rule for using private proxies with google at the moment its recommended to use 1 connection per every 20-30+ proxies for basic keywrod scraping.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |