UMBRELA: UMbrela is the (Open-Source Reproduction of the) Bing RELevance Assessor.
Shivani UpadhyayRonak PradeepNandan ThakurNick CraswellJimmy LinPublished in: CoRR (2024)
Keyphrases
- open source
- search engine
- relevance judgments
- relevance assessments
- source code
- open source software
- learning to rank algorithms
- information retrieval
- test collection
- case study
- relevance feedback
- internet search
- user experience
- ranking algorithm
- retrieval effectiveness
- evaluation metrics
- web scale
- end users
- probabilistic model