From Sparse to Soft Mixtures of Experts.

Joan Puigcerver Carlos Riquelme Basil Mustafa Neil Houlsby

Published in: CoRR (2023)

Keyphrases

mixture model
sparse data
case study
expectation maximization

domain experts
mixtures of gaussians
information retrieval
high dimensional

human experts
expert finding
knowledge base
domain knowledge

sparse coding
parametric models
random projections
elastic net