Java Web Crawler: Difference between revisions
Jump to navigation
Jump to search
| Line 17: | Line 17: | ||
| valign="top" | | | valign="top" | | ||
* [https://stackoverflow.com/questions/11559464/ EhCache overflow to disk at specific path] | * [https://stackoverflow.com/questions/11559464/ EhCache overflow to disk at specific path] | ||
* [https://javabeat.net/enablecaching-spring/ <code>@EnableCaching</code> Annotation in Spring] | |||
|} | |} | ||
Revision as of 04:08, 1 October 2020
A web crawler, or spider, is a type of bot that's typically operated by search engines like Google and Bing. Their purpose is to index the content of websites all across the Internet so that those websites can appear in search engine results.