Web scraper to get data

I need a scraper to gather data from a web site and periodically to update. This web site is [login to view URL] See files in this order Agent [login to view URL] Agent Search [login to view URL] Agent search companies this agent can [login to view URL] Agent search companies this agent can represent [login to view URL] Agency [login to view URL] Agency Data [login to view URL] Agency [login to view URL] Company data [login to view URL] Formost_Company Data fields to scrape_sample data [login to view URL] Please look through the attached files in the order as listed. We are trying to formulate a database of insurance agents, the companies they can underwrite for and the companies they are appointed with. Along with that we need to collect the agency information. This data contains information about how big the company is- how many agents they have and what types of insurance they sell. Lastly, we need company information, it contains the types of insurance the company can sell. Starting with the Agent [login to view URL] file I have highlighted the data fields we are trying to capture. Moving to the Agent Search Information image file I have indicated which fields we need to collect. Next, We will need a relational data base that can locate the results of a query for the Agent search, which types of insurances they can sell, appointments they have and we need to incorporate the companies fields - this will help us identify how big of a company this agent is with, how long they have been there, what types of insurances this company can sell. In summary, each web site search page only displays some of the total information we are trying to collect in whole We think we need a relational data base to: Search for insurance agents that sell a particular type of insurance Search for a company that has a certain number of agents Search for a particular type of underwriting capability Search for company name/ Sort by company name alphabetical Search by city- search by state- search by insurance type- search by size of company Search by company name. we need to display as many records of the complete data set as practical Agent information Types of appointments Company years of service State City Corrective actions Company types of insurance they sell We need to export data to perform mailing lists- calling lists We also need contact information which the agency search site does not provide. If there are smarter ways to do this please advise. We need a spider to use the Agent, Agency and Company lists to crawl the web and look for Agent Web pages, email addresses. Example might be that the company lists the agent email address as a contact resource, or the agent has a personal web page that includes her company information as a cross reference.