Test Collection-Based IR Evaluation Needs Extension toward Sessions - A Case of Extremely Short Queries.
Heikki KeskustaloKalervo JärvelinAri PirkolaTarun SharmaMarianne LykkePublished in: AIRS (2009)
Keyphrases
- ir evaluation
- test collection
- short queries
- search sessions
- retrieval effectiveness
- information retrieval
- search tasks
- query expansion
- search engine
- statistical significance
- relevant documents
- relevance assessments
- retrieval systems
- patent retrieval
- average precision
- document collections
- pseudo relevance feedback
- retrieval model
- language model
- relevance model
- spoken document retrieval
- user behavior
- relevance feedback
- retrieved documents
- log data
- information seeking
- metadata