On the Effect of Pretraining Corpora on In-context Learning by a Large-scale Language Model.
Seongjin ShinSang-Woo LeeHwijeen AhnSungdong KimHyoungSeok KimBoseop KimKyunghyun ChoGichang LeeWoo-Myoung ParkJung-Woo HaNako SungPublished in: NAACL-HLT (2022)
Keyphrases
- language model
- context sensitive
- language modeling
- speech recognition
- document retrieval
- information retrieval
- active learning
- hidden markov models
- probabilistic model
- machine learning
- statistical machine translation
- retrieval model
- ad hoc information retrieval
- translation model
- n gram
- unsupervised learning
- supervised learning