Daniel Hesslow

Publication Activity (10 Years)

Years Active: 2021-2023
Publications (10 Years): 17

Top Topics

Neural Architectures

Incremental Mining

Top Venues

Publications

Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Alessandro Cappelli, Hamza Alobeidli, Baptiste Pannier, Ebtesam Almazrouei, Julien Launay
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data, and Web Data Only. CoRR (2023)
Guilherme Penedo, Quentin Malartic, Daniel Hesslow, Ruxandra Cojocaru, Hamza Alobeidli, Alessandro Cappelli, Baptiste Pannier, Ebtesam Almazrouei, Julien Launay
The RefinedWeb Dataset for Falcon LLM: Outperforming Curated Corpora with Web Data Only. NeurIPS (2023)
Ebtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, Alessandro Cappelli, Ruxandra Cojocaru, Mérouane Debbah, Étienne Goffinet, Daniel Hesslow, Julien Launay, Quentin Malartic, Daniele Mazzotta, Badreddine Noune, Baptiste Pannier, Guilherme Penedo
The Falcon Series of Open Language Models. CoRR (2023)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Lucile Saulnier, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? CoRR (2022)
Matthew J. Filipovich, Alessandro Cappelli, Daniel Hesslow, Julien Launay
Scaling Laws Beyond Backpropagation. CoRR (2022)
Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
What Language Model Architecture and Pretraining Objective Works Best for Zero-Shot Generalization? ICML (2022)
Daniel Hesslow, Niccoló Zanichelli, Pascal Notin, Iacopo Poli, Debora S. Marks
RITA: a Study on Scaling Up Generative Protein Sequence Models. CoRR (2022)
Teven Le Scao, Angela Fan, Christopher Akiki, Ellie Pavlick, Suzana Ilic, Daniel Hesslow, Roman Castagné, Alexandra Sasha Luccioni, François Yvon, Matthias Gallé, Jonathan Tow, Alexander M. Rush, Stella Biderman, Albert Webson, Pawan Sasanka Ammanamanchi, Thomas Wang, Benoît Sagot, Niklas Muennighoff, Albert Villanova del Moral, Olatunji Ruwase, Rachel Bawden, Stas Bekman, Angelina McMillan-Major, Iz Beltagy, Huu Nguyen, Lucile Saulnier, Samson Tan, Pedro Ortiz Suarez, Victor Sanh, Hugo Laurençon, Yacine Jernite, Julien Launay, Margaret Mitchell, Colin Raffel, Aaron Gokaslan, Adi Simhi, Aitor Soroa, Alham Fikri Aji, Amit Alfassy, Anna Rogers, Ariel Kreisberg Nitzav, Canwen Xu, Chenghao Mou, Chris Emezue, Christopher Klamm, Colin Leong, Daniel van Strien, David Ifeoluwa Adelani, et al.
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model. CoRR (2022)
Teven Le Scao, Thomas Wang, Daniel Hesslow, Stas Bekman, M. Saiful Bari, Stella Biderman, Hady Elsahar, Niklas Muennighoff, Jason Phang, Ofir Press, Colin Raffel, Victor Sanh, Sheng Shen, Lintang Sutawika, Jaesung Tae, Zheng Xin Yong, Julien Launay, Iz Beltagy
What Language Model to Train if You Have One Million GPU Hours? EMNLP (Findings) (2022)
Thomas Wang, Adam Roberts, Daniel Hesslow, Teven Le Scao, Hyung Won Chung, Iz Beltagy, Julien Launay, Colin Raffel
What Language Model Architecture and Pretraining Objective Work Best for Zero-Shot Generalization? CoRR (2022)
Daniel Hesslow, Alessandro Cappelli, Igor Carron, Laurent Daudet, Raphaël Lafargue, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli
Photonic co-processors in HPC: Using LightOn OPUs for Randomized Numerical Linear Algebra. HCS (2021)
Charles Brossollet, Alessandro Cappelli, Igor Carron, Charidimos Chaintoutis, Amélie Chatelain, Laurent Daudet, Sylvain Gigan, Daniel Hesslow, Florent Krzakala, Julien Launay, Safa Mokaadi, Fabien Moreau, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli, Giuseppe Luca Tommasone
LightOn Optical Processing Unit: Scaling-up AI and HPC with a Non von Neumann co-processor. CoRR (2021)
Daniel Hesslow, Alessandro Cappelli, Igor Carron, Laurent Daudet, Raphaël Lafargue, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli
Photonic co-processors in HPC: using LightOn OPUs for Randomized Numerical Linear Algebra. CoRR (2021)
Amélie Chatelain, Amine Djeghri, Daniel Hesslow, Julien Launay
Is the Number of Trainable Parameters All That Actually Matters? ICBINB@NeurIPS (2021)
Amélie Chatelain, Amine Djeghri, Daniel Hesslow, Julien Launay, Iacopo Poli
Is the Number of Trainable Parameters All That Actually Matters? CoRR (2021)
Daniel Hesslow, Iacopo Poli
Contrastive Embeddings for Neural Architectures. CoRR (2021)
Charles Brossollet, Alessandro Cappelli, Igor Carron, Charidimos Chaintoutis, Amélie Chatelain, Laurent Daudet, Sylvain Gigan, Daniel Hesslow, Florent Krzakala, Julien Launay, Safa Mokaadi, Fabien Moreau, Kilian Müller, Ruben Ohana, Gustave Pariente, Iacopo Poli, Giuseppe Luca Tommasone
LightOn Optical Processing Unit : Scaling-up AI and HPC with a Non von Neumann co-processor. HCS (2021)