Carlo Luschi

Publication Activity (10 Years)

Years Active: 1995-2024
Publications (10 Years): 20

Top Topics

Training Process

Top Venues

Publications

Paul Balanca, Sam Hosegood, Carlo Luschi, Andrew W. Fitzgibbon
Scalify: scale propagation for efficient low-precision LLM training. CoRR (2024)
Charlie Blake, Constantin Eichenberg, Josef Dean, Lukas Balles, Luke Y. Prince, Björn Deiseroth, Andrés Felipe Cruz-Salinas, Carlo Luschi, Samuel Weinbach, Douglas Orr
u-μP: The Unit-Scaled Maximal Update Parametrization. CoRR (2024)
Alexander Mathiasen, Hatem Helal, Paul Balanca, Adam Krzywaniak, Ali Parviz, Frederik Hvilshøj, Blazej Banaszewski, Carlo Luschi, Andrew William Fitzgibbon
Reducing the Cost of Quantum Chemical Data By Backpropagating Through Density Functional Theory. CoRR (2024)
Alexander Mathiasen, Hatem Helal, Kerstin Klaser, Paul Balanca, Josef Dean, Carlo Luschi, Dominique Beaini, Andrew W. Fitzgibbon, Dominic Masters
. CoRR (2023)
Luka Ribar, Ivan Chelombiev, Luke Hudlass-Galley, Charlie Blake, Carlo Luschi, Douglas Orr
SparQ Attention: Bandwidth-Efficient LLM Inference. CoRR (2023)
Charlie Blake, Douglas Orr, Carlo Luschi
Unit Scaling: Out-of-the-Box Low-Precision Training. CoRR (2023)
Alexander Mathiasen, Hatem Helal, Kerstin Klaser, Paul Balanca, Josef Dean, Carlo Luschi, Dominique Beaini, Andrew W. Fitzgibbon, Dominic Masters
. NeurIPS (2023)
Sergio P. Perez, Yan Zhang, James Briggs, Charlie Blake, Josh Levy-Kramer, Paul Balanca, Carlo Luschi, Stephen Barlow, Andrew William Fitzgibbon
Training and inference of large language models using 8-bit floating point. CoRR (2023)
Charlie Blake, Douglas Orr, Carlo Luschi
Unit Scaling: Out-of-the-Box Low-Precision Training. ICML (2023)
Alberto Cattaneo, Daniel Justus, Harry Mellor, Douglas Orr, Jérôme Maloberti, Zhenying Liu, Thorin Farnsworth, Andrew W. Fitzgibbon, Blazej Banaszewski, Carlo Luschi
BESS: Balanced Entity Sampling and Sharing for Large-Scale Knowledge Graph Completion. CoRR (2022)
Badreddine Noune, Philip Jones, Daniel Justus, Dominic Masters, Carlo Luschi
8-bit Numerical Formats for Deep Neural Networks. CoRR (2022)
Dominic Masters, Antoine Labatie, Zach Eaton-Rosen, Carlo Luschi
Making EfficientNet More Efficient: Exploring Batch-Independent Normalization, Group Convolutions and Reduced Resolution Training. CoRR (2021)
Ivan Chelombiev, Daniel Justus, Douglas Orr, Anastasia Dietrich, Frithjof Gressmann, Alexandros Koliousis, Carlo Luschi
GroupBERT: Enhanced Transformer Architecture with Efficient Grouped Structures. CoRR (2021)
Antoine Labatie, Dominic Masters, Zach Eaton-Rosen, Carlo Luschi
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence. CoRR (2021)
Antoine Labatie, Dominic Masters, Zach Eaton-Rosen, Carlo Luschi
Proxy-Normalizing Activations to Match Batch Normalization while Removing Batch Dependence. NeurIPS (2021)
Anastasia Dietrich, Frithjof Gressmann, Douglas Orr, Ivan Chelombiev, Daniel Justus, Carlo Luschi
Towards Structured Dynamic Sparse Pre-Training of BERT. CoRR (2021)
Frithjof Gressmann, Zach Eaton-Rosen, Carlo Luschi
Improving Neural Network Training in Low Dimensional Random Bases. NeurIPS (2020)
Frithjof Gressmann, Zach Eaton-Rosen, Carlo Luschi
Improving Neural Network Training in Low Dimensional Random Bases. CoRR (2020)
Michael Laskin, Luke Metz, Seth Nabarrao, Mark Saroufim, Badreddine Noune, Carlo Luschi, Jascha Sohl-Dickstein, Pieter Abbeel
Parallel Training of Deep Networks with Local Updates. CoRR (2020)
Dominic Masters, Carlo Luschi
Revisiting Small Batch Training for Deep Neural Networks. CoRR (2018)
Carlo Luschi, Bernard Mulgrew
Estimation of the output error statistics of space-time equalization in an antenna array EGPRS receiver with soft-decision decoding. IEEE Trans. Wirel. Commun. 4 (4) (2005)
Carlo Luschi, Bernard Mulgrew
Nonparametric trellis equalization in the presence of non-Gaussian interference. IEEE Trans. Commun. 51 (2) (2003)
Carlo Luschi, Magnus Sandell, Paul Strauch, Jian-Jun Wu, Costel Ilas, Ping-Wen Ong, Romain Baeriswyl, Frederic Battaglia, Spyros Karageorgis, Ran-Hong Yan
Advanced signal-processing algorithms for energy-efficient wireless communications. Proc. IEEE 88 (10) (2000)
Paul Strauch, Carlo Luschi, Magnus Sandell, Ran Yan
Low complexity source controlled channel decoding in a GSM system. ICASSP (1999)
Franco Guglielmi, Carlo Luschi, Arnaldo Spalvieri
Joint clock recovery and baseband combining for the diversity radio channel. IEEE Trans. Commun. 44 (1) (1996)
Franco Guglielmi, Carlo Luschi, Arnaldo Spalvieri
Joint Clock Recovery and Baseband Combining for the Diversity Radio Channel. IEEE Trans. Commun. 43 (12) (1995)