lo-fi: distributed fine-tuning without communication.
Mitchell WortsmanSuchin GururanganShen LiAli FarhadiLudwig SchmidtMichael G. RabbatAri S. MorcosPublished in: Trans. Mach. Learn. Res. (2023)
Keyphrases
- fine tuning
- communication overhead
- communication cost
- spatially distributed
- computer networks
- distributed control
- fine tune
- distributed systems
- viable alternative
- distributed computation
- distributed network
- distributed data
- multi party
- learning objects
- communication networks
- concurrent processes
- distributed environment
- fine tuned
- database systems
- multimedia communication
- communication systems
- mobile agents
- lightweight
- database
- information dissemination
- heterogeneous environments
- communication technologies
- agent technology
- group communication
- information sharing
- fully distributed
- domain specific
- remote sites
- global knowledge
- general purpose
- multi robot coordination