- Juan Kyser
- Research Papers
- Meta Crawlers
HOW SEARCH ENGINES WORK AND A WEB CRAWLER APPLICATION
The main purpose of this project is to present the anatomy of a large scale Hyper textTransfer Protocol (HTTP) based Web search engine by using the system architecture of large search engines such as Google, Yahoo as a prototype. Additionally, a web crawler is developed and implemented in Java v1.4.2, which demonstrates the operation of a typical Web crawler.
- Hits: 914