Determining Bias to Search Engines from Robots.txt.
Yang SunZiming ZhuangIsaac G. CouncillC. Lee GilesPublished in: Web Intelligence (2007)
Keyphrases
- search engine
- web search engines
- cooperative
- multi robot
- web search
- web pages
- search queries
- information retrieval
- mobile robot
- robotic agents
- meta search engine
- robotic systems
- autonomous systems
- autonomous robots
- internet search
- humanoid robot
- keywords
- information access
- neural network
- language model
- search result
- human robot interaction
- web queries
- robot control
- keyword search
- query logs
- retrieval systems
- tactile sensing
- human agent interaction