Login / Signup

AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers.

Ganesh JawaharSubhabrata MukherjeeXiaodong LiuYoung Jin KimMuhammad Abdul-MageedLaks V. S. LakshmananAhmed Hassan AwadallahSébastien BubeckJianfeng Gao
Published in: CoRR (2022)
Keyphrases
  • neural architecture
  • search algorithm
  • neural network
  • search space
  • machine learning
  • knn
  • general purpose
  • basis functions
  • efficient implementation
  • activation function