IRLbot: scaling to 6 billion pages and beyond.

Hsin-Tsang Lee Derek Leonard Xiaoming Wang Dmitri Loguinov

Published in: WWW (2008)

Keyphrases

website
search engine
web pages
page layout
machine learning
databases
keywords
information extraction
web documents
web information
artificial intelligence
information systems
real world
e learning
dynamic content
dynamically generated
html pages
data sets