Atli Kosson

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 12

Top Topics

Error Back Propagation

Backpropagation Algorithm

Top Venues

Publications

Alexander Hägele, Elie Bakouch, Atli Kosson, Loubna Ben Allal, Leandro von Werra, Martin Jaggi
Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations. CoRR (2024)
Atli Kosson, Dongyang Fan, Martin Jaggi
Ghost Noise for Regularizing Deep Neural Networks. AAAI (2024)
Atli Kosson, Bettina Messmer, Martin Jaggi
Rotational Optimizers: Simple & Robust DNN Training. CoRR (2023)
Atli Kosson, Martin Jaggi
Hardware-Efficient Transformer Training via Piecewise Affine Operations. CoRR (2023)
Basile Lewandowski, Atli Kosson
Memory Efficient Mixed-Precision Optimizers. CoRR (2023)
Atli Kosson, Dongyang Fan, Martin Jaggi
Ghost Noise for Regularizing Deep Neural Networks. CoRR (2023)
Atli Kosson, Martin Jaggi
Multiplication-Free Transformer Training via Piecewise Affine Operations. NeurIPS (2023)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. MLSys (2021)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. CoRR (2020)
Abhinav Venigalla, Atli Kosson, Vitaliy Chiley, Urs Köster
Adaptive Braking for Mitigating Gradient Delay. CoRR (2020)
Vitaliy Chiley, Ilya Sharapov, Atli Kosson, Urs Köster, Ryan Reece, Sofia Samaniego de la Fuente, Vishal Subbiah, Michael James
Online Normalization for Training Neural Networks. NeurIPS (2019)
Vitaliy Chiley, Ilya Sharapov, Atli Kosson, Urs Köster, Ryan Reece, Sofia Samaniego de la Fuente, Vishal Subbiah, Michael James
Online Normalization for Training Neural Networks. CoRR (2019)