A Full Distributed Web Crawler Based on Structured Network.

Kunpeng Zhu Zhiming Xu Xiaolong Wang Yuming Zhao

Published in: AIRS (2008)

Keyphrases

web crawler
peer to peer
distributed systems
network structure
complex networks
machine learning
database
mobile agents
communication channels
web crawlers