Diversifying the Expert Knowledge for Task-Agnostic Pruning in Sparse Mixture-of-Experts.
Zeliang ZhangXiaodong LiuHao ChengChenliang XuJianfeng GaoPublished in: CoRR (2024)
Keyphrases
- expert knowledge
- domain experts
- expert systems
- domain knowledge
- knowledge engineering
- fuzzy logic
- mixture model
- bayesian networks
- prior knowledge
- knowledge elicitation
- search space
- pruning method
- knowledge acquisition
- sparse data
- knowledge base
- learned knowledge
- domain specific
- avoid overfitting
- pruning algorithm
- sparse representation
- sparse matrix
- high dimensional
- compressed sensing
- pruning methods
- neural network
- tree pruning
- learning mechanism
- gaussian distribution
- human experts
- expectation maximization
- image classification
- genetic algorithm
- data mining