Web crawling ethics revisited: Cost, privacy, and denial of service.
Mike ThelwallDavid StuartPublished in: J. Assoc. Inf. Sci. Technol. (2006)
Keyphrases
- web crawling
- dos attacks
- denial of service
- search engine
- network security
- topic specific
- denial of service attacks
- web mining
- privacy preserving
- web data
- link analysis
- data mining
- data mining and machine learning
- information retrieval
- set covering
- focused crawling
- deep web
- text categorization
- lightweight
- security issues
- personal information
- data integration
- metadata