spider/crawler/scraper needed to compile a survey

We need a script/application that we can leave running on a PC that will crawl the web, preferably with editable limits (e.g. just .com domains, or just pages within a specific domain) and compile data. It needs to log the page name, URL, and results for about 3 criteria.... 1) Does the site use frames (y/n) 2) Does the page have a Doctype declaration (y/n) 3) Does the page code validate (might be too difficult, let me know your thoughts) Please state how you will achieve this, how the logged data can be accessed (ideally a spreadsheet), and post examples if you have done similar things.