Physics of Language Models: Part 1, Context-Free Grammar.
Zeyuan Allen-ZhuYuanzhi LiPublished in: CoRR (2023)
Keyphrases
- language model
- context free grammars
- language modeling
- grammatical inference
- probabilistic model
- context free languages
- n gram
- information retrieval
- document retrieval
- language modelling
- query expansion
- retrieval model
- test collection
- language models for information retrieval
- context sensitive
- vector space model
- production rules
- artificial intelligence
- smoothing methods
- pseudo relevance feedback
- retrieval effectiveness
- query terms
- database systems
- regular expressions
- relevance model
- xml schema
- information extraction