Research Papers Library

  2. Home
  3. Research Papers
  4. Meta Crawlers
  5. MetaCrawler Architecture for Resource Aggregation on Web
Jeremy Frink
Research Papers
Meta Crawlers

MetaCrawler Architecture for Resource Aggregation on Web

The MetaCrawler Softbot is a parallel Web search service that has been available at the University of Washington since June of 1995. It provides users with a single interface with which they can query popular general-purpose Web search services, such as Lycos and AltaVista, and has some sophisticated features that allow it to obtain results of much higher quality than simply regurgitating the output from each search service. In this article, we brie y outline the motivation for MetaCrawler and highlight previous work, and then discuss the architecture of MetaCrawler and how it enables MetaCrawler to perform well and to scale and adapt to a dynamic Internet.

Download PDF

Hits: 901

Research Paper Archives

Live Classes Schedule

AOFIRS

World's leading professional association of Internet Research Specialists - We deliver Knowledge, Education, Training, and Certification in the field of Professional Online Research. The AOFIRS is considered a major contributor in improving Web Search Skills and recognizes Online Research work as a full-time occupation for those that use the Internet as their primary source of information.

Get Exclusive Research Tips in Your Inbox

Receive Great tips via email, enter your email to Subscribe.

KNOWLEDGE NETWORK