Java Web Crawler: Difference between revisions

From Chorke Wiki
Jump to navigation Jump to search
m (Protected "Java Web Crawler" ([Edit=Allow only administrators] (indefinite) [Move=Allow only administrators] (indefinite)))
(No difference)

Revision as of 04:54, 1 October 2020

A web crawler, or spider, is a type of bot that's typically operated by search engines like Google and Bing. Their purpose is to index the content of websites all across the Internet so that those websites can appear in search engine results.

References