A Forwarding-Based Task Scheduling Algorithm for Distributed Web Crawling over DHTs.

Xiao Xu Weizhe Zhang Hongli Zhang Binxing Fang Xinran Liu

Published in: ICPADS (2009)

Keyphrases

web crawling
distributed systems
overlay network
peer to peer
web mining
distributed environment
search engine
topic specific
deep web
link analysis
load balancing
data mining and machine learning
web data
text categorization
digital libraries
data mining
database
database systems
multimedia