Change Rate Estimation and Optimal Freshness in Web Page Crawling.
Konstantin AvrachenkovKishor PatilGugan ThoppePublished in: VALUETOOLS (2020)
Keyphrases
- web pages
- search engine
- estimation error
- website
- response time
- link analysis
- web mining
- dynamic programming
- optimal solution
- web search
- closed form
- web graph
- optimal control
- neural network
- web crawlers
- focused crawling
- estimation accuracy
- web page clustering
- estimation algorithm
- web data
- ranking algorithm
- web search engines
- information extraction
- genetic algorithm