I need some data mined off a large website.
The project must be done through proxies and over a given time.
The goal is to collect several million records to fill a leads form. This can exported into a csv file.
It will work as follows.
Step 1.) Search for leads with a minimum number of reviews, and minimum overall score.
Step 2.) If lead qualifies, collect website, phone number, city, state, description, about us.
Step 3.) Use website, if applicable, to scrape the website and find an email address.
Step 4.) Write new entry if there are no duplicate records found..
All data from step 2 is available on the same page.
When searching the website, Step 3, the scraper will look in order for, Footer, Contact Us, About Us when choosing the emails.
Of course there are going to be variations on the name, example "contact" us vs "contact", just make it work 100% of the time.
For the email address, it will take up to 5 email addresses, and be saved as email-1, email-2, etc... this is to help with the lead process in getting email address correct.
For accessing this data, it will require the use of multiple cities, and trades to search relevant people.
Before adding a new piece of data, the record has to be checked for duplicate entries, as to not write multiple records.
I'm looking to obtain 10 - 20 million records.
There must be a csv file for data dump,
as well as a individual files for each state, in case of size issues.
Please let me know what you have to offer and we can start immediately.
Hello, I can scrape 10-20M leads with no problem, but it's not clear where you want me to scrape those from? i.e. what is the source for step 1) and what you consider "qualified" lead for step 2) ?
next, it's not really possible to scrape email from random website 100% of the time because some emails protected pretty well from scraping, however I have neural-network assisted scraper that is able to get email from random site in most of the cases. Thanks!
Hello,
I have gone through your job posting and become very much interested to work with you. I am an expert in this field. I have already completed several projects like this. For evidence you can see my profile.
Please visit : https://www.freelancer.com/u/schoudhary1553
I have excellent command over English. I am a hard worker, productive and worthy of your attention I hope, I would be the right candidate for this post. Awaiting an affirmative response from you.
Kinds Regards,
Sandeep
Dear Customer! I have built many scrapers. This is my favorite type of job. I am absolutely confident I can complete your project easily and on time. Ready to begin and finish as soon as possible. Please contact to discuss in more details. Thank you.
I will write a custom script to do the scraping, are you looking for me to run the script of will you be able to run it yourself? can you let me know the website address?
Hi
My name is Bingbing, a high-skilled Web scrapper
Our approach is consultative - we will discuss and work through the details unique process and flow to build out the Backend and API for the maximum utilization.
This is more than just about putting some fields in the module
Ensuring that you are capturing the right information is paramount
For more information about us or to discuss the development direction, please get in touch with us
Thanks
Hello Sir,
Please take a look at my reviews and portfolio. I have completed web/data scraping jobs many times. I am interested in your project as well. I would like to discuss details via pm. I look forward to hearing from you soon.
Best Regards,
Dear sir, How are you?
I am scraping it using python and output the data as an Excel file.
My work completion time is fastest and the price is very good.
I am a web scraping expert.
I will ensure that all the data you want is accurate and fast.
You will see through my profile that I have guaranteed great scraping work for many clients.
I will wait for your good response.
Thanks and Best regards!
JinXueTian
HI SIR
I AM SCRAPE FOR YOU FULL INFORMATION AS YOU NEEDED FROM COMPLEX WEBSITE CHARGE YOU 100$ FOR 1 MILLION CONTACTS
WE DISCUSS MORE WITH SAMPLE THANKS
Hi
Greetings of the day
I would love to have the opportunity to discuss your project with you I have more than 8 years experience in Website Development but later joined Freelancer. I believe my skills are a match for your project and I have a good grasp of working with CMS and Frameworks, I would be easily able to achieve the task, and I'd like to start things off on the right foot. It would be great if we can have small discussion as this will enable us to make sure we communicate well and that we both are completely comfortable with the scope of the project. Please let me know a time that works best for you and I will make sure that I make myself available.
My everyday time are flexible. I'm very energized to provide my best solutions for your job. Please you can get in touch with me immediately to talk about this place further.
Thank you for your time and consideration.
Regards
Gagandeep Singh
Hi, This is Shrikant.
I have 8+ years of experience working with leading IT houses. After working these many years working for companies, I decided to work individually as a freelances and in past 2-3 years, I have delivered more than 40 projects including IT and Non-IT projects such as Website development, API integration and data scrapping.
I would like to discuss further. Let me know if you find my profile fit in your requirements.
Thank you
I am website developer and expert in data entry and graphic designing and all types of website expert in development
Relevant Skills and Experience
I am website developer and expert in data entry and graphic designing and all types of website expert in development
I am pleased to inform you that our offering of Crawling Solutions will be the right solution to comply to your requirement.
The functionalities of Scraping / Crawling Solutions is as mentioned below,
- Fetch the details targeted websites in quick time
- More than 98% accuracy in scraping the information
- Provision of IP-Management and de-captcha resolution
- More than 10 years of experience in industry domain
- User defined output to be delivered i.e. excel / csv, JSON, HTML etc.
- Output delivery via Email, FTP, API etc.
Do let me know if you require further details from our side.
We have experience in fetching the pricing and other information on a regular basis from more than 250 websites on a regular basis.
The partial list of the websites are as mentioned below,
- LinkedIn
- Facebook
- Twitter
- Yellowpages
- Super pages
- Amazon
- Ebay
- Rakuten
- Wallmart
- Insight
- Kikatek
- CDiscount
- Sephore
- Bechtel
- Farfetch
- Zoho
- Mouser
- bestbuy
- officedepot
Do let me know if you require further details from our side.
Hello there,
I am a computer engineer with nearly 8 years of software development experience, mainly in .net technologies. I have worked in quite good companies and have developed lots of automated tests with with using web scraping technologies for them. I am also developing a system which crawls multiple bet sites data continously for my own usage. I am trying to say that, I am really expert on web crawling. I am going to use Selenium Web Driver and HtmlAgilityPack library for web access and C# for backend management. I can send you some samples today. Please let me explain what i will do technically, which technologies i will use and what kind of process will be waiting for us during the development of the project. I guarantee you will be pleased if you give me a chance. So you can get your project with a good quality at the most reasonable price and I can get a nice comment and 5 stars from you. Please let me share my resume and linkedin profile as private message before deciding.
