Computer Science, asked by kumarhitesh47541, 10 months ago

What technology do search engines use to 'crawl' websites?

Answers

Answered by ʙʀᴀɪɴʟʏᴡɪᴛᴄh
3

Answer:

Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index. We use a huge set of computers to fetch (or "crawl") billions of pages on the web. The program that does the fetching is called Googlebot (also known as a robot, bot, or spider)...............................

Answered by Anonymous
7

Answer:

Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index. We use a huge set of computers to fetch (or "crawl") billions of pages on the web. The program that does the fetching is called Googlebot (also known as a robot, bot, or spider).

Similar questions