MegaBlocks: Efficient Sparse Training with Mixture-of-Experts.

Trevor Gale Deepak Narayanan Cliff Young Matei Zaharia

Published in: CoRR (2022)

Keyphrases

information retrieval
test set
data sets
e learning
sparse representation
information systems
training set
domain knowledge
semi supervised
object detection
lightweight
training examples
compressive sensing