Heaps' Law in GPT-Neo Large Language Model Emulated Corpora.
Uyen LaiGurjit S. RandhawaPaul SheridanPublished in: CoRR (2023)
Keyphrases
- language model
- language modeling
- statistical machine translation
- n gram
- document retrieval
- information retrieval
- language modelling
- probabilistic model
- speech recognition
- test collection
- natural language processing
- query expansion
- retrieval model
- context sensitive
- ad hoc information retrieval
- vector space model
- pseudo relevance feedback
- language models for information retrieval
- smoothing methods
- document ranking
- relevance model
- query terms
- mixture model
- machine translation
- text documents
- document length
- dirichlet prior
- relevant documents