BASE Layers: Simplifying Training of Large, Sparse Models.

Mike Lewis Shruti Bhosale Tim Dettmers Naman Goyal Luke Zettlemoyer

Published in: CoRR (2021)

Keyphrases

experimental data
training set
online learning
complex systems
statistical models
data sets
knowledge base
parameter estimation
neural network model
accurate models