Java Web Crawler: Difference between revisions
Jump to navigation
Jump to search
| Line 8: | Line 8: | ||
* [https://stackoverflow.com/questions/11282503/java-web-crawler-libraries#:~:text=Selenium%20Components Java Web Crawler Libraries] | * [https://stackoverflow.com/questions/11282503/java-web-crawler-libraries#:~:text=Selenium%20Components Java Web Crawler Libraries] | ||
* [https://www.cloudflare.com/en-gb/learning/bots/what-is-a-web-crawler/#:~:text=A%20web%20crawler%2C%20or%20spider,appear%20in%20search%20engine%20results What Is a Web Crawler?] | * [https://www.cloudflare.com/en-gb/learning/bots/what-is-a-web-crawler/#:~:text=A%20web%20crawler%2C%20or%20spider,appear%20in%20search%20engine%20results What Is a Web Crawler?] | ||
* [https://docs.liquibase.com/workflows/database-setup-tutorials/sqlite.html Liquibase with SQLite] | |||
* [https://www.selenium.dev/projects/ Selenium Projects] | * [https://www.selenium.dev/projects/ Selenium Projects] | ||
* [https://docs.spring.io/spring-data/data-redis/docs/current/reference/html/ Spring Data Redis] | * [https://docs.spring.io/spring-data/data-redis/docs/current/reference/html/ Spring Data Redis] | ||
* [https://www.baeldung.com/spring-boot-sqlite SQLite Dialect] | * [https://www.baeldung.com/spring-boot-sqlite SQLite Dialect] | ||
Revision as of 04:52, 27 September 2020
A web crawler, or spider, is a type of bot that's typically operated by search engines like Google and Bing. Their purpose is to index the content of websites all across the Internet so that those websites can appear in search engine results.