Wisdom of Committee: Distilling from Foundation Model to Specialized Application Model.
Zichang LiuQingyun LiuYuening LiLiang LiuAnshumali ShrivastavaShuchao BiLichan HongEd H. ChiZhe ZhaoPublished in: CoRR (2024)
Keyphrases
- hybrid model
- statistical model
- cost function
- analytical model
- theoretical foundation
- mathematical model
- formal model
- high level
- linear model
- objective function
- prior knowledge
- probabilistic model
- general purpose
- metamodel
- computational model
- decision making
- parameter estimation
- sensitivity analysis
- experimental data
- data sets
- knowledge base
- learning algorithm
- machine learning
- databases