Promises and Pitfalls of Generative Masked Language Modeling: Theoretical Framework and Practical Guidelines.
Yuchen LiAlexandre KirchmeyerAashay MehtaYilong QinBoris DadachevKishore PapineniSanjiv KumarAndrej RisteskiPublished in: CoRR (2024)
Keyphrases
- theoretical framework
- language modeling
- practical guidelines
- language model
- discriminative models
- case study
- probabilistic model
- query expansion
- information retrieval
- retrieval model
- generative model
- language modeling framework
- evaluation process
- n gram
- text classification
- machine learning
- document retrieval
- information retrieval systems
- fundamental principles
- text mining
- real world
- statistical language modeling