AMPeD: An Analytical Model for Performance in Distributed Training of Transformers.
Diksha MoolchandaniJoyjit KunduFrederik RuelensPeter VrancxTimon EvenblijManu PerumkunnilPublished in: ISPASS (2023)
Keyphrases
- analytical model
- analytical models
- distributed environment
- distributed systems
- supervised learning
- database
- peer to peer
- distributed data
- training algorithm
- training phase
- cooperative
- multi agent
- learning algorithm
- online learning
- loosely coupled
- training process
- simulation model
- distributed network
- fault tolerant
- test set
- training examples
- active learning
- multi agent systems
- decision trees
- information systems
- machine learning
- data sets
- real time