LM-Polygraph: Uncertainty Estimation for Language Models.
Ekaterina FadeevaRoman VashurinAkim TsvigunArtem VazhentsevSergey PetrakovKirill FedyaninDaniil VasilevElizaveta GoncharovaAlexander PanchenkoMaxim PanovTimothy BaldwinArtem ShelmanovPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- document retrieval
- n gram
- probabilistic model
- query expansion
- language modelling
- speech recognition
- information retrieval
- test collection
- retrieval model
- context sensitive
- mixture model
- ad hoc information retrieval
- vector space model
- statistical language models
- okapi bm
- language model for information retrieval
- term dependencies
- possibility theory
- uncertain data
- document ranking
- word error rate
- cross lingual
- query terms
- co occurrence