MegaBlocks: Efficient Sparse Training with Mixture-of-Experts.

Trevor Gale Deepak Narayanan Cliff Young Matei Zaharia

Published in: MLSys (2023)

Keyphrases

test set
cost effective
neural network
genetic algorithm
training set
training process
case study
image sequences
artificial neural networks
supervised learning
image classification