Old BERT, New Tricks: Artificial Language Learning for Pre-Trained Language Models.
Lisa BylininaAlexey TikhonovEkaterina GarmashPublished in: CoRR (2021)
Keyphrases
- language learning
- language model
- pre trained
- language modeling
- training data
- n gram
- training examples
- information retrieval
- speech recognition
- language modelling
- query expansion
- probabilistic model
- retrieval model
- foreign language
- computer assisted language learning
- statistical language models
- mobile learning
- language models for information retrieval
- supervised learning
- mobile language learning
- smoothing methods
- small number
- control signals
- e learning
- relevance model
- data sets
- decision trees