Improving a gold standard: treating human relevance judgments of MEDLINE document pairs.
W. John WilburWon KimPublished in: BMC Bioinform. (2011)
Keyphrases
- gold standard
- human relevance judgments
- semi automatic
- ground truth
- test collection
- language model
- web search engines
- document images
- information retrieval
- web documents
- information retrieval systems
- precision recall
- document collections
- text mining
- keywords
- retrieval systems
- relevant documents
- document retrieval
- user queries
- semantic information
- search engine
- query terms
- document clustering
- relevance judgments
- scoring function
- multimedia
- mechanical turk