Web robot detection techniques based on statistics of their requested URL resources.
Weigang GuoShiguang JuYi GuPublished in: CSCWD (1) (2005)
Keyphrases
- website
- web pages
- web resources
- web documents
- web crawler
- mobile robot
- automatic detection
- detection method
- information resources
- detection algorithm
- online resources
- web information
- web users
- false alarms
- web content
- resource allocation
- vision system
- web applications
- object detection
- information retrieval
- resource management
- information gathering
- robotic systems
- web data
- linked data
- detection rate
- web mining
- real time
- semantic web
- user generated content
- information sources
- anomaly detection
- web technologies
- information extraction
- keywords
- information providers