I have a WebCrawler project files written in Java. My project requirements are listed below:
Please read before you apply:
1- I have a method in my project that calculate URLs waiting time inside frontier (I am using Priority Queue as frontier to store parsed URLs inside it). I am using (Maximum Waiting Time) for every URL, when a URL is reached this Max time it will dropping. I Need to calculate the position of dropped URL inside PriorityQueue.
2- I need to add some methods that stores (downloads) the crawled URLs (WebPages) on local disk.
3- Writing some class in (Java) to apply (Inverted-Indexing) on stored (downloaded) WebPages.
NOTE: You will maybe need to add an extra classes (or import them to project) to clean HTML files (like: stemming, stopwords etc.) before applying (Inverted-Index) algorithm on downloaded WebPages.
4- You will store the indexed WebPages on database. I prefer using MySQL to do it.
5- Need a simple GUI for making search and show the results on screen for end-user.
- Please DO NOT apply if you don't have idea about indexing or you did not worked on WebCrawler or indexing WebPages before.
- The project in written in Java so any advice to change the project programming language will not be acceptable.
- Thank you for you interesting
- I will need fully commented code.
7 freelancers están ofertando el promedio de $250 para este trabajo
Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi
I am Senior Java Developer with more than 10 years of experience in Java design and development with strong problem solving skills. [login to view URL]