BASE Layers: Simplifying Training of Large, Sparse Models.

Mike Lewis Shruti Bhosale Tim Dettmers Naman Goyal Luke Zettlemoyer

Published in: ICML (2021)

Keyphrases

complex systems
statistical models
support vector
prior knowledge
probabilistic model
supervised learning
experimental data
structured prediction
data sets
neural network
video sequences
generative model
machine learning algorithms
statistical model
mathematical models