Data Scrapper Crawler Harvesting need to add new sites
$100-500 USD
Cancelado
Publicado hace más de 12 años
$100-500 USD
Pagado a la entrega
Please quote the amount of days from the moment when the project is assigned to accomplish and specify which site or sites from the list below you are choosing to scrap. Home depot is the easiest one, I think. Please do not apply if you do not have normal Internet access or planning me to do part of work for you.
I currently have working scraper for Amazon, which give this screen to help to sort/normalize the data after download
![][1]
It works normally except one error: --- Exception ---
8/9/2011 9:37:05 PM: [login to view URL]: Index was outside the bounds of the array.
at [login to view URL](List`1 list, ItemWithImage item, Boolean manufacturer)
at [login to view URL](IList`1 itemsAndImages)
at [login to view URL]()
at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
at [login to view URL](ExecutionContext executionContext, ContextCallback callback, Object state)
at [login to view URL]()
I am planning to add following sites to the data extraction, parsing and processing: HomeDepot (tools only), BestBuy, Sears, Frys, Walmart, Target, eBay, GoogleShopping
You are expected to:
A. Fix the error and assure that exception is handled
B. Add parsers for any site you will pick from the list above
Current program is written in C# and I have source code.
I will provide you the data and samples of links.