Learning Light-Weight Translation Models from Deep Transformer.

Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu

Published in: CoRR (2020)

Keyphrases

lightweight
prior knowledge
learning models
accurate models
learned models
supervised learning
learning algorithm
deep learning
deep architectures
online learning
active learning
learning process
learning systems
statistical models
semi supervised
qualitative models
probabilistic model
reinforcement learning