Mercator: A Scalable, Extensible Web Crawler.

Allan Heydon Marc Najork

Published in: World Wide Web (1999)

Keyphrases

web crawler
web crawlers
data model
data types
topic specific
web crawling
web pages
website
deep web
web forums
data mining
social networks
metadata
object oriented