ASTRA-sim2.0: Modeling Hierarchical Networks and Disaggregated Systems for Large-model Training at Scale.
William WonTaekyung HeoSaeed RashidiSrinivas SridharanSudarshan SrinivasanTushar KrishnaPublished in: CoRR (2023)
Keyphrases
- management system
- expert systems
- network model
- prior knowledge
- computational model
- mathematical model
- dynamic aspects
- modeling framework
- metamodel
- hierarchical structure
- complex systems
- similarity measure
- neural network
- conceptual model
- scale space
- training set
- training algorithm
- modeling method
- hierarchical model
- structured prediction
- high level