A distributed multi-tasking job scheduling mechanism for web crawlers.

Cheng-Hung Tsai Tsun Ku Ping-Yen Yang Ming-Jen Chen

Published in: SoCPaR (2014)

Keyphrases

job scheduling
web crawlers
multi tasking
grid environment
operating system
web applications
distributed systems
web server
web crawler
peer to peer
web sources
end users
search engine
multi agent
data management
resource allocation
scheduling algorithm
social media
web crawling
digital libraries
web pages