Token Dropping for Efficient BERT Pretraining.

Le Hou Richard Yuanzhe Pang Tianyi Zhou Yuexin Wu Xinying Song Xiaodan Song Denny Zhou

Published in: CoRR (2022)

Keyphrases

computationally expensive
data sets
real time
neural network
machine learning
artificial intelligence
decision trees
database systems
computational complexity
cost effective