A Comparative Analysis of Distributed Training Strategies for GPT-2.
Ishan PatwardhanShubham GandhiOm M. KhareAmit JoshiSuraj SawantPublished in: CoRR (2024)
Keyphrases
- distributed systems
- cooperative
- training set
- training phase
- training process
- distributed environment
- communication overhead
- agent technology
- data sets
- distributed search
- distributed architecture
- distributed computing
- fault tolerant
- test set
- online learning
- peer to peer
- supervised learning
- multi agent
- real time
- training samples
- constraint satisfaction problems
- lightweight
- mobile agents
- text classification
- search strategies
- communication cost
- information systems
- artificial intelligence
- machine learning