Relevance Judgments for Web Services Retrieval - A Methodology and Test Collection for SWS Discovery Evaluation.
Ulrich KüsterBirgitta König-RiesPublished in: ECOWS (2009)
Keyphrases
- test collection
- relevance judgments
- evaluation methodology
- web services
- retrieval systems
- human relevance judgments
- average precision
- retrieval model
- relevance assessments
- information retrieval
- retrieval effectiveness
- semantic web services
- relevant documents
- document collections
- information retrieval evaluation
- relevance feedback
- service description
- language model
- ir evaluation
- evaluation of information retrieval systems
- search tasks
- xml retrieval
- retrieval strategies
- query performance prediction
- relevance judgements
- service discovery
- learning to rank
- queries and relevance judgments
- information retrieval systems
- user oriented evaluation
- trec web
- ranking functions
- precision recall
- query terms
- document retrieval
- image retrieval
- multimedia