Statistical Perspective of Top-K Sparse Softmax Gating Mixture of Experts.

Huy Nguyen Pedram Akbarian Fanqi Yan Nhat Ho

Published in: CoRR (2023)

Keyphrases

statistical models
statistical analysis
high dimensional
viewpoint
statistical information
query processing
expectation maximization
mixture model
information theoretic
statistical methods
compressive sensing
data driven
domain experts
statistical inference
gaussian mixture model
exponential family