A learning algorithm for the Whittle index policy for scheduling web crawlers.

Konstantin Avrachenkov Vivek S. Borkar

Published in: Allerton (2019)

Keyphrases

web crawlers
learning algorithm
web applications
web crawling
web server
web crawler
web pages
web sources
online social
search engine
reinforcement learning
database
deep web
data extraction