Gating Dropout: Communication-efficient Regularization for Sparsely Activated Transformers.

Rui Liu Young Jin Kim Alexandre Muzio Hany Hassan

Published in: ICML (2022)

Keyphrases

database
convex optimization
real time
data sets
search engine
information systems
decision trees
lightweight
cost effective
communication networks
communication technologies
communication protocol