Large language models implicitly learn to straighten neural sentence trajectories to construct a predictive representation of natural language.
Eghbal A. HosseiniEvelina FedorenkoPublished in: NeurIPS (2023)
Keyphrases
- language model
- natural language
- language modeling
- natural language sentences
- n gram
- statistical language models
- information retrieval
- language modelling
- document retrieval
- speech recognition
- probabilistic model
- retrieval model
- document level
- test collection
- query expansion
- context sensitive
- vector space model
- image representation
- language models for information retrieval
- machine learning
- information extraction
- part of speech
- dependency structure
- relevance model
- query terms
- sentence retrieval
- language processing
- language model for information retrieval
- term dependencies
- passage retrieval
- smoothing methods
- parse tree
- ad hoc information retrieval
- spoken term detection