Critical Phase Transition in a Large Language Model.
Kai NakaishiYoshihiko NishikawaKoji HukushimaPublished in: CoRR (2024)
Keyphrases
- language model
- phase transition
- language modeling
- constraint satisfaction
- randomly generated
- probabilistic model
- satisfiability problem
- n gram
- document retrieval
- speech recognition
- hard problems
- query expansion
- np complete
- information retrieval
- retrieval model
- random constraint satisfaction problems
- language modelling
- test collection
- statistical language models
- mixture model
- context sensitive
- sat problem
- random instances
- pseudo relevance feedback
- query terms
- statistical machine translation
- ad hoc information retrieval
- language model for information retrieval
- cellular automata
- vector space model
- sat instances
- query specific
- document length