A Simple Contrastive Learning Objective for Alleviating Neural Text Degeneration.
Shaojie JiangRuqing ZhangSvitlana VakulenkoMaarten de RijkePublished in: CoRR (2022)
Keyphrases
- learning algorithm
- learning process
- information retrieval
- neural network
- biologically plausible
- prior knowledge
- learning systems
- artificial intelligence
- active learning
- supervised learning
- online learning
- learning tasks
- incremental learning
- recurrent networks
- learning analytics
- biologically inspired
- network architecture
- cognitive load
- elementary school
- database
- text retrieval
- learning problems
- semantic information
- learning styles
- unsupervised learning
- hidden markov models
- support vector
- metadata