Improving a Gold Standard: Treating Human Relevance Judgments of MEDLINE Document Pairs.
Won KimW. John WilburPublished in: ICMLA (2010)
Keyphrases
- gold standard
- human relevance judgments
- semi automatic
- test collection
- ground truth
- language model
- web search engines
- document collections
- information retrieval systems
- relevance judgments
- information retrieval
- retrieval systems
- document images
- keywords
- pairwise
- precision recall
- web documents
- relevant documents
- text mining
- text documents
- augmented reality
- retrieval model
- vector space model
- feature space
- user interaction
- mechanical turk