Script to increase page count of multiple pages by 1

Completado Publicado Jan 19, 2016 Pagado a la entrega
Completado Pagado a la entrega

We want to a script to visit the URL's that we have. We have a lot of URLS, we want you to make script to ping them all one by one. Once pinged, we also want you to update in our database the “count” (you add 1 to whatever is in the field) and your bot’s last visit date, so that we do not visit that page again.

There needs to be Random time wait between 1 to 2 seconds on page

The spider bot should look like a real visitor. It’s only useful if site registers bot as a real user. Use browser headers so site sees visitor as a regular visitor

User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.8.1.14) Gecko/20080404 Firefox/2.0.0.14

We have a list of Referral URL's too that you can use for each visit.

We want to use Different Proxies for visiting pages. We have a proxy list subscription (list is provided in JSON/XML form), but we will need script to verify if proxy is working or not. Or skip to next proxy if we get HTTP error. In your bid, mention if you can provide clean IPs.

We want to set this up on AWS server, mention in bid, if you can do that on AWS.

I will give you a list of urls to test on. Counter updates after every 4 hours, but we have many urls so we can test accordingly.

Our URL list is in Mysql. We will give you a text file for testing first and if your script incurs +1 visit, then we will hire you.

Here’s a sample page – [login to view URL]

Perl PHP Python

Nº del proyecto: #9380347

Sobre el proyecto

13 propuestas Proyecto remoto Activo Jan 20, 2016

Adjudicado a:

fejs

Hi Sir/Madam, I'm expert in Python programming and I might help You with this task. I can do: random wait, change headers, change proxies. I haven't been working with AWS, so can't guarantee I can do it. Best rega Más

$120 USD en 3 días
(142 comentarios)
6.3

13 freelancers están ofertando un promedio de $220 por este trabajo

TopSEOExpertscom

Hi, Why not do it as a desktop tool as it'll be easier and cost less than running it on a web server. Please initiate chat if you're interested in further discussion.

$833 USD en 10 días
(316 comentarios)
8.0
prashushinde9

Hello, I understood the initial scope of this project. Although i want to discuss further this job in order to prepare the final concept for this project. After Complete discussion over the call or in chat, i Más

$257 USD en 10 días
(53 comentarios)
7.1
davidphp5

Hi, I can do this project for you. I know PHP well, and I've done similar jobs before. Please check my profile, and if you're interested, contact me with more details! Best regards, David

$200 USD en 1 día
(40 comentarios)
5.6
mohankumarelec

Hi, I am a student who is good at coding in python and I have done lot of similar projects to this. This can be done by using mechanize library to open the URL and that mechanize browser can be set with proxies and hea Más

$111 USD en 3 días
(32 comentarios)
5.6
mukes72

Hi i can write a python script which can ping on your given url list with defined user-agent and list of proxies. I have experience on writing python web scrapper with user-agent and proxy list. Please ask me to Más

$111 USD en 3 días
(7 comentarios)
3.7
pycoons

We understand your requirements and will do it in python. For further details and clarifications feel free to contact us.

$161 USD en 2 días
(11 comentarios)
3.4