URL ordering policies for distributed crawlers: a review.
DeepikaAshutosh DixitPublished in: CoRR (2016)
Keyphrases
- partial ordering
- total ordering
- partial order
- web pages
- website
- distributed systems
- cooperative
- data sets
- multi agent
- lightweight
- optimal policy
- multi agent systems
- web server
- search engine
- literature review
- web crawler
- information retrieval
- web crawlers
- distributed environment
- computing environments
- distributed data
- database