Designing clustering-based web crawling policies for search engine crawlers.
Qingzhao TanPrasenjit MitraC. Lee GilesPublished in: CIKM (2007)
Keyphrases
- web crawling
- search engine
- web crawlers
- topic specific
- focused crawling
- web mining
- web search
- web crawler
- web search engines
- web pages
- user queries
- keywords
- information retrieval
- link analysis
- deep web
- data mining
- web data
- data mining and machine learning
- query logs
- search queries
- end users
- retrieval systems
- web documents
- web applications