A Scalable Lightweight Distributed Crawler for Crawling with Limited Resources.
Milly KcMarkus HagenbuchnerAh Chung TsoiPublished in: Web Intelligence/IAT Workshops (2008)
Keyphrases
- lightweight
- limited resources
- search engine
- processing power
- web pages
- web crawlers
- web crawling
- web crawler
- focused crawling
- computing resources
- wireless sensor networks
- website
- resource limitations
- focused crawler
- web server
- topic specific
- development environments
- communication networks
- dos attacks
- web mining
- distributed systems