Lorenzo Noci

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 24

Top Topics

Theoretical Perspectives

Top Venues

Publications

Blake Bordelon, Lorenzo Noci, Mufan Bill Li, Boris Hanin, Cengiz Pehlevan
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit. ICLR (2024)
Bobby He, Lorenzo Noci, Daniele Paliotta, Imanol Schlag, Thomas Hofmann
Understanding and Minimising Outlier Features in Neural Network Training. CoRR (2024)
Kai Lion, Lorenzo Noci, Thomas Hofmann, Gregor Bachmann
How Good is a Single Basin? CoRR (2024)
Kai Lion, Lorenzo Noci, Thomas Hofmann, Gregor Bachmann
How Good is a Single Basin? AISTATS (2024)
Lorenzo Noci, Alexandru Meterez, Thomas Hofmann, Antonio Orvieto
Why do Learning Rates Transfer? Reconciling Optimization and Scaling Limits for Deep Learning. CoRR (2024)
Gul Sena Altintas, Gregor Bachmann, Lorenzo Noci, Thomas Hofmann
Disentangling Linear Mode-Connectivity. CoRR (2023)
Sanghwan Kim, Lorenzo Noci, Antonio Orvieto, Thomas Hofmann
Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning. CVPR (2023)
Sotiris Anagnostidis, Dario Pavllo, Luca Biggio, Lorenzo Noci, Aurélien Lucchi, Thomas Hofmann
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers. CoRR (2023)
Blake Bordelon, Lorenzo Noci, Mufan Bill Li, Boris Hanin, Cengiz Pehlevan
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit. CoRR (2023)
Lorenzo Noci, Chuning Li, Mufan Bill Li, Bobby He, Thomas Hofmann, Chris J. Maddison, Dan Roy
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit. NeurIPS (2023)
Lorenzo Noci, Chuning Li, Mufan Bill Li, Bobby He, Thomas Hofmann, Chris Maddison, Daniel M. Roy
The Shaped Transformer: Attention Models in the Infinite Depth-and-Width Limit. CoRR (2023)
Sotiris Anagnostidis, Dario Pavllo, Luca Biggio, Lorenzo Noci, Aurélien Lucchi, Thomas Hofmann
Dynamic Context Pruning for Efficient and Interpretable Autoregressive Transformers. NeurIPS (2023)
Sanghwan Kim, Lorenzo Noci, Antonio Orvieto, Thomas Hofmann
Achieving a Better Stability-Plasticity Trade-off via Auxiliary Networks in Continual Learning. CoRR (2023)
Sotiris Anagnostidis, Gregor Bachmann, Lorenzo Noci, Thomas Hofmann
The Curious Case of Benign Memorization. ICLR (2023)
Sotiris Anagnostidis, Gregor Bachmann, Lorenzo Noci, Thomas Hofmann
The Curious Case of Benign Memorization. CoRR (2022)
Gregor Bachmann, Lorenzo Noci, Thomas Hofmann
How Tempering Fixes Data Augmentation in Bayesian Neural Networks. ICML (2022)
Gregor Bachmann, Lorenzo Noci, Thomas Hofmann
How Tempering Fixes Data Augmentation in Bayesian Neural Networks. CoRR (2022)
Lorenzo Noci, Sotiris Anagnostidis, Luca Biggio, Antonio Orvieto, Sidak Pal Singh, Aurélien Lucchi
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse. CoRR (2022)
Lorenzo Noci, Sotiris Anagnostidis, Luca Biggio, Antonio Orvieto, Sidak Pal Singh, Aurélien Lucchi
Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse. NeurIPS (2022)
Lorenzo Noci, Gregor Bachmann, Kevin Roth, Sebastian Nowozin, Thomas Hofmann
Precise characterization of the prior predictive distribution of deep ReLU networks. CoRR (2021)
Lorenzo Noci, Kevin Roth, Gregor Bachmann, Sebastian Nowozin, Thomas Hofmann
Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect. CoRR (2021)
Lorenzo Noci, Gregor Bachmann, Kevin Roth, Sebastian Nowozin, Thomas Hofmann
Precise characterization of the prior predictive distribution of deep ReLU networks. NeurIPS (2021)
Lorenzo Noci, Kevin Roth, Gregor Bachmann, Sebastian Nowozin, Thomas Hofmann
Disentangling the Roles of Curation, Data-Augmentation and the Prior in the Cold Posterior Effect. NeurIPS (2021)
Mario Arduini, Lorenzo Noci, Federico Pirovano, Ce Zhang, Yash Raj Shrestha, Bibek Paudel
Adversarial Learning for Debiasing Knowledge Graph Embeddings. CoRR (2020)