Learning Light-Weight Translation Models from Deep Transformer.

Bei Li Ziyang Wang Hui Liu Quan Du Tong Xiao Chunliang Zhang Jingbo Zhu

Published in: AAAI (2021)

Keyphrases

lightweight
learning systems
prior knowledge
learning rules
deep architectures
learning algorithm
learning process
active learning
supervised learning
knowledge acquisition
low cost
online learning
statistical models
structured prediction
accurate models