SuperShaper: Task-Agnostic Super Pre-training of BERT Models with Variable Hidden Dimensions.

Vinod Ganesan Gowtham Ramesh Pratyush Kumar

Published in: CoRR (2021)

Keyphrases

probabilistic model
complex systems
genetic algorithm
online learning
mathematical models
real time
artificial intelligence
bayesian networks
multi agent systems
d objects
training samples
training examples
test set
statistical model
statistical methods