Role of Web Crawler in Search Engine

Research areas:

• Volume 2,Issue 1, July. 2013

Year:

2013

Type of Publication:

Article

Keywords:

World Wide Web, Search Engines

Authors:

Dr. Yaduvir Singh; Mr. Pavan Sharma; Dr. Hariom Sharma

Journal:

IJAIM

Volume:

2

Number:

1

Pages:

1-2

Month:

July

ISSN:

2320-5121

Abstract:

Web Crawler is one of the important components of any search engine. A number of web crawlers are available in the market. The job of a web crawler is to navigate the web and extract new pages for the storage in the database of the search engines. It also involves the traversing, parsing and other considerable issues. Also to achieve better and fast results, parallel crawlers are used.

Full text: IJAIM_112_Final.pdf