From Sparse to Soft Mixtures of Experts.

Joan Puigcerver Carlos Riquelme Basil Mustafa Neil Houlsby

Published in: CoRR (2023)

Keyphrases

mixture model
sparse data
case study
expectation maximization
domain experts
mixtures of gaussians
information retrieval
high dimensional
human experts
expert finding
knowledge base
domain knowledge
sparse coding
parametric models
random projections
elastic net