AngularJS and Node app to scrape data into MongoDB

Create an Angular JS app together with a NodeJS app where it's possible to start a scrape data from [login to view URL] and import through a rest API. Mockup: [login to view URL] 1. Doing sampling - Add a select box to pick a site to scrape data from (Today only [login to view URL]) - Pick number of ads from [login to view URL] to get per category - When user clicks Sample button - Add a row in a mongodb collection called samples (in a database called adminio) With data site: [login to view URL] adsPerCategory: *data from form input* adsTotal: NULL status: in-progress - Run in background a script that goes through every category on [login to view URL] and browse to every page and load the number of ads as was defined in "adsPerCategory" in database. For every ad fetch this and map to mongo structure header -> [login to view URL] description -> [login to view URL] currency -> [login to view URL] price -> [login to view URL] county -> [login to view URL] id -> id photos: [{medium}] -> [login to view URL]: [{src: }] [login to view URL] -> [login to view URL] [login to view URL] -> [login to view URL] age -> [login to view URL] ([login to view URL] - age) friendlyUrl -> [login to view URL] publisherName -> [login to view URL] [login to view URL] -> [login to view URL] So final mongo structure looks like: { site: "[login to view URL]", adsPerCategory: 500, adsTotal: 22001, status: "done", items: [{ id: 2313, content: { title: "TITLE", body: "TEXT FOR AD", price: { amount: 1000.22, currency: "EUR" }, location: { city: "Stockholm" }, photos: [{ src: "http://..." }, { src: "http://..." }], category: { id: 123, name: "A category" }, createdAt: "2015-20-22 10:00", url: "http://...", }, user: { name: "NAME", id: 12345 } }] } - While sampling is running add to table under the form and instead of import button show "Sampling in progress..." - Once done and if page is reloaded show green button with text "Import to sentinel" - When clicking on "Import to Sentinel" - Go to this page [login to view URL] - Let user supply a token. - When click on "Import all 3000 ads" start background job that reads the ads from mongodb and insert them into a REST API with same structure as in mongodb. Only 1000 ads per time so insert 1000, sleep 1 second, insert 1000, sleep 1 second and so on. - While importing show this [login to view URL] - When import is done change text to "Success"