Sign in

Wins: Discovering Efficient Activation Functions for Sparse LLMs.

Zhengyan ZhangYixin SongGuanghui YuXu HanYankai LinChaojun XiaoChenyang SongZhiyuan LiuZeyu MiMaosong Sun
Published in: CoRR (2024)
Keyphrases
  • activation function
  • neural network
  • artificial neural networks
  • feature selection
  • high dimensional
  • signal processing
  • back propagation