Detecting Web Crawlers from Web Server Access Logs with Data Mining Classifiers.
Dusan StevanovicAijun AnNatalija VlajicPublished in: ISMIS (2011)
Keyphrases
- web server
- web crawlers
- access logs
- data mining
- web users
- website
- web pages
- database server
- knowledge discovery
- end users
- data mining techniques
- web search engines
- machine learning
- association rules
- data analysis
- web usage mining
- social networks
- log files
- access patterns
- text mining
- mobile agents
- search engine
- business applications
- web crawling
- databases
- language model
- data warehouse