Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?
Yutong HuQuzhe HuangMingxu TaoChen ZhangYansong FengPublished in: Tiny Papers @ ICLR (2024)
Keyphrases
- language model
- text understanding
- language modeling
- natural language understanding
- document retrieval
- probabilistic model
- n gram
- retrieval model
- information retrieval
- speech recognition
- query expansion
- natural language text
- natural language processing
- mixture model
- computational linguistics
- ad hoc information retrieval
- translation model
- word error rate
- topic modeling
- smoothing methods
- topic models
- data analysis
- relevance model
- search engine
- machine learning