Can Perplexity Reflect Large Language Model's Ability in Long Text Understanding?
Yutong HuQuzhe HuangMingxu TaoChen ZhangYansong FengPublished in: CoRR (2024)
Keyphrases
- language model
- text understanding
- language modeling
- natural language understanding
- n gram
- document retrieval
- information retrieval
- speech recognition
- retrieval model
- computational linguistics
- probabilistic model
- query expansion
- natural language text
- natural language processing
- ad hoc information retrieval
- smoothing methods
- word error rate
- pseudo relevance feedback
- mixture model
- document level
- domain specific
- question answering
- error rate
- semantic analysis
- knowledge representation
- data analysis
- artificial intelligence