Question

What is the use of web crawler in information retrieval?

Answer 1

web crowleris an internet bot that systematically browses the www typically for the purpose of web indexing (web spidering).

Answer 2

Answer:

the search engines used extremely efficient software called spider or web crawler... the spiders continuously crawl on a web to come out any newly published web documents news letters and find their web addresses....as soon as a user enters a keyword in a search engine , these spiders crawl from one server to another in a matter of microseconds to compile a massive list of matching results...

hope this helps u