Lifelong Language Pretraining with Distribution-Specialized Experts.
Wuyang ChenYanqi ZhouNan DuYanping HuangJames LaudonZhifeng ChenClaire CuiPublished in: CoRR (2023)
Keyphrases
- programming language
- general purpose
- natural language
- specification language
- probability distribution
- language processing
- domain experts
- competence development
- expert advice
- operational semantics
- uniformly distributed
- gaussian distribution
- language learning
- real time
- artificial intelligence
- information retrieval
- machine learning
- neural network