Pre-training Co-evolutionary Protein Representation via A Pairwise Masked Language Model.
Liang HeShizhuo ZhangLijun WuHuanhuan XiaFusong JuHe ZhangSiyuan LiuYingce XiaJianwei ZhuPan DengBin ShaoTao QinTie-Yan LiuPublished in: CoRR (2021)
Keyphrases
- language model
- pairwise
- language modeling
- n gram
- document retrieval
- probabilistic model
- retrieval model
- language modelling
- speech recognition
- query expansion
- information retrieval
- test collection
- context sensitive
- relevance model
- query terms
- mixture model
- ad hoc information retrieval
- supervised learning
- smoothing methods
- training set
- search engine
- pseudo relevance feedback
- vector space model
- markov random field
- translation model
- document ranking
- spectral clustering
- word error rate
- similarity measure
- word clouds