Activations and Gradients Compression for Model-Parallel Training.

Mikhail Rudakov Aleksandr Beznosikov Yaroslav Kholodov Alexander V. Gasnikov

Published in: CoRR (2024)

Keyphrases

computational model
mathematical model
artificial neural networks
probabilistic model
statistical model
machine learning
management system
em algorithm
theoretical analysis
test set
theoretical framework
shared memory