Paolo Glorioso

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 5

Top Topics

Language Modeling

Improvements In Retrieval Effectiveness

Genetic Algorithm

Top Venues

Publications

Paolo Glorioso, Quentin Anthony, Yury Tokpanov, James Whittington, Jonathan Pilault, Adam Ibrahim, Beren Millidge
Zamba: A Compact 7B SSM Hybrid Model. CoRR (2024)
Yury Tokpanov, Beren Millidge, Paolo Glorioso, Jonathan Pilault, Adam Ibrahim, James Whittington, Quentin Anthony
Zyda: A 1.3T Dataset for Open Language Modeling. CoRR (2024)
Quentin Anthony, Yury Tokpanov, Paolo Glorioso, Beren Millidge
BlackMamba: Mixture of Experts for State-Space Models. CoRR (2024)
Andrey Gromov, Kushal Tirumala, Hassan Shapourian, Paolo Glorioso, Daniel A. Roberts
The Unreasonable Ineffectiveness of the Deeper Layers. CoRR (2024)
Aditya Cowsik, Tankut Can, Paolo Glorioso
Flatter, faster: scaling momentum for optimal speedup of SGD. CoRR (2022)