DrBERT: Unveiling the Potential of Masked Language Modeling Decoder in BERT pretraining.
Wen LiangYouzhi LiangPublished in: CoRR (2024)
Keyphrases
- language modeling
- language model
- information retrieval
- finite state transducers
- retrieval model
- n gram
- query expansion
- probabilistic model
- cross lingual
- statistical language models
- text classification
- relevance model
- statistical language modeling
- trec collections
- improvements in retrieval effectiveness
- information retrieval systems
- machine translation
- data mining
- retrieval effectiveness
- information extraction
- comparable corpora