Construction of an Annotation Test Collection for Search Evaluation on Digital Libraries.
Maristella AgostiTullio CoppotelliNicola FerroPublished in: IRCDL (2007)
Keyphrases
- test collection
- relevance judgements
- digital libraries
- evaluation campaigns
- evaluation methodology
- relevance judgments
- ir evaluation
- relevance assessments
- evaluation of information retrieval systems
- document collections
- xml retrieval
- trec web track
- information retrieval evaluation
- retrieval effectiveness
- information access
- search tasks
- information retrieval
- retrieval model
- metadata
- relevant documents
- retrieval strategies
- retrieval systems
- average precision
- metadata creation
- language model
- patent retrieval
- active learning
- relevance feedback
- document image analysis
- loss function
- search sessions
- statistical significance
- relevance scores
- focused retrieval
- anchor text
- information extraction
- trec web
- information seeking
- evaluation methods