Optimal Web Page Download Scheduling Policies for Green Web Crawling.
Vassiliki HatziBerkant Barla CambazogluIordanis KoutsopoulosPublished in: IEEE J. Sel. Areas Commun. (2016)
Keyphrases
- web crawling
- scheduling policies
- search engine
- web data
- topic specific
- web pages
- scheduling algorithm
- website
- load balancing
- web crawlers
- web mining
- link analysis
- data mining
- queueing networks
- keywords
- heavy traffic
- machine learning
- web search
- optimal solution
- web users
- web server
- deep web
- web search engines
- web documents
- round robin
- information extraction
- focused crawling
- dynamic programming