The Sociolinguistic Foundations of Language Modeling.
Jack GrieveSara BartlMatteo FuoliJason GrafmillerWeihang HuangAlejandro JawerbaumAkira MurakamiMarcus PerlmanDana RoemlingBodo WinterPublished in: CoRR (2024)
Keyphrases
- language modeling
- language model
- retrieval model
- information retrieval
- query expansion
- n gram
- probabilistic model
- cross lingual
- artificial intelligence
- relevance model
- text classification
- trec collections
- statistical language models
- document retrieval
- improvements in retrieval effectiveness
- smoothing methods
- test collection
- word segmentation
- search engine
- language modeling approaches
- comparable corpora
- machine learning
- topic models
- web documents
- multimedia
- digital libraries
- principal component analysis