Demystifying Softmax Gating in Gaussian Mixture of Experts.
Huy NguyenTrungTin NguyenNhat HoPublished in: CoRR (2023)
Keyphrases
- gaussian mixture
- mixtures of gaussians
- em algorithm
- gaussian mixture model
- expectation maximization
- probability density function
- closed form
- covariance matrix
- density estimation
- gaussian density
- mixture model
- mixture of gaussians
- probability density
- natural images
- high dimensional
- kl divergence
- information retrieval
- neural network