lo-fi: distributed fine-tuning without communication.
Mitchell WortsmanSuchin GururanganShen LiAli FarhadiLudwig SchmidtMichael G. RabbatAri S. MorcosPublished in: CoRR (2022)
Keyphrases
- fine tuning
- communication overhead
- communication cost
- viable alternative
- computer networks
- fully distributed
- distributed control
- distributed systems
- fine tune
- cooperative
- distributed computation
- distributed environment
- multi agent
- spatially distributed
- communication systems
- multimedia communication
- exchange information
- peer to peer
- neural network
- information exchange
- distributed network
- open systems
- information dissemination
- distributed data
- information sharing
- learning objects
- concurrent processes
- fine tuned
- multi party
- global knowledge
- communication protocol
- real time
- lightweight
- databases
- data sets