LLM Inference Unveiled: Survey and Roofline Model Insights.
Zhihang YuanYuzhang ShangYang ZhouZhen DongZhe ZhouChenhao XueBingzhe WuZhikai LiQingyi GuYong Jae LeeYan YanBeidi ChenGuangyu SunKurt KeutzerPublished in: CoRR (2024)
Keyphrases
- management system
- probability distribution
- formal model
- computational model
- experimental data
- social networks
- bayesian networks
- probabilistic model
- statistical model
- conceptual model
- bayesian inference
- database
- random fields
- probabilistic inference
- prediction model
- neural network model
- closed form
- theoretical framework
- theoretical analysis
- hidden markov models
- control system
- learning algorithm
- real time