A Survey on Efficient Training of Transformers.

Bohan Zhuang Jing Liu Zizheng Pan Haoyu He Yuetian Weng Chunhua Shen

Published in: IJCAI (2023)

Keyphrases

training set
cost effective
data sets
data structure
pairwise
evolutionary algorithm
lightweight
feedforward neural networks