NLoPT: N-gram Enhanced Low-Rank Task Adaptive Pre-training for Efficient Language Model Adaption.
Hao GuJiangyan YiZheng LianJianhua TaoXinrui YanPublished in: LREC/COLING (2024)
Keyphrases
- n gram
- language model
- low rank
- language modeling
- language modelling
- test collection
- probabilistic model
- convex optimization
- document retrieval
- bag of words
- matrix factorization
- text classification
- information retrieval
- retrieval model
- missing data
- query expansion
- vector space model
- translation model
- singular value decomposition
- semi supervised
- query terms
- document ranking
- high dimensional data
- linear combination
- statistical language modeling
- text documents
- collaborative filtering
- least squares
- information extraction
- data analysis
- pattern recognition