R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models.
Shangqing TuYuanchun WangJifan YuYuyang XieYaran ShiXiaozhi WangJing ZhangLei HouJuanzi LiPublished in: KDD (2024)
Keyphrases
- language model
- domain knowledge
- retrieval model
- document retrieval
- test collection
- query expansion
- language modeling
- language models for information retrieval
- ad hoc information retrieval
- information retrieval
- statistical language models
- smoothing methods
- n gram
- probabilistic model
- document length
- query terms
- relevance model
- document ranking
- query generation
- cross language retrieval
- passage retrieval
- speech recognition
- query specific
- language modelling
- okapi bm
- retrieval effectiveness
- out of vocabulary
- vector space model
- document level
- ir models
- context sensitive
- text retrieval
- translation model
- statistical language modeling
- pseudo feedback
- pseudo relevance feedback
- image database
- ad hoc retrieval
- term dependencies
- average precision
- relevant documents
- inter document similarities
- language model for information retrieval
- sentence retrieval
- expert finding
- xml retrieval
- term frequency
- cross language information retrieval
- retrieval method
- context dependent
- retrieval systems
- information retrieval systems
- relevance feedback
- training data