UbiCrawler: a scalable fully distributed Web crawler.

Paolo Boldi Bruno Codenotti Massimo Santini Sebastiano Vigna

Published in: Softw. Pract. Exp. (2004)

Keyphrases

fully distributed
web crawler
cooperative
peer to peer
topic specific
overlay network
deep web
multi agent systems
distributed search
website
web crawling
web documents
loosely coupled
databases
search engine
web pages
business processes
key distribution
digital libraries
similarity measure