Volume : V, Issue : X, October - 2016

A STUDY ON WORKING OF WEB CRAWLER

Niti Saxena

Abstract :

 As with growing technological research and advancements, information on the web is increasing vastly and exponentially. Every second we have increase in valuable information. But information retrieval on time is challenge for survival with abundance of data on web and different user perspective. While searching out for some data, unlimited or limited based on the search, thousands or hundreds of results were appear as result. As far user time is precious and he or she might be impatient to look or go through each and every page listed. Search engine basically helps us getting track of information user wants to access and are interested in. It tracks the information based on user preferences and sort results within some specified time frame according to relevancy of user preferences. The top results are the main attraction for user which is a big challenge as there are number of technologies that lists out the relevant information according to user preferences as fast as possible. Crawling is one of such an important underlying technique that makes the search engine more effective, reliable and useful. Web Crawlers are techniques that traverse through web searching and fetch out the pages for relevant and preferable information inside specific subject area from millions, billions or trillions of web pages on internet

Keywords :

Article: Download PDF   DOI : 10.36106/ijsr  

Cite This Article:

Niti Saxena A STUDY ON WORKING OF WEB CRAWLER International Journal of Scientific Research,Volume : 5 | Issue : 10 | October 2016

Number of Downloads : 454

References :