Utku Evci

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 32

Top Topics

Language Understanding

Structured Sparsity

Reinforcement Learning

Top Venues

Publications

Mike Lasby, Anna Golubeva, Utku Evci, Mihai Nica, Yani Ioannou
Dynamic Sparse Training with Structured Sparsity. ICLR (2024)
Elias Frantar, Carlos Riquelme Ruiz, Neil Houlsby, Dan Alistarh, Utku Evci
Scaling Laws for Sparsely-Connected Foundation Models. ICLR (2024)
Abhimanyu Rajeshkumar Bambhaniya, Amir Yazdanbakhsh, Suvinay Subramanian, Sheng-Chun Kao, Shivani Agrawal, Utku Evci, Tushar Krishna
Progressive Gradient Flow for Robust N: M Sparsity Training in Transformers. CoRR (2024)
Ghada Sokar, Rishabh Agarwal, Pablo Samuel Castro, Utku Evci
The Dormant Neuron Phenomenon in Deep Reinforcement Learning. CoRR (2023)
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin F. Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Patrick Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah Harmsen, Neil Houlsby
Scaling Vision Transformers to 22 Billion Parameters. CoRR (2023)
Ghada Sokar, Rishabh Agarwal, Pablo Samuel Castro, Utku Evci
The Dormant Neuron Phenomenon in Deep Reinforcement Learning. ICML (2023)
Joo Hyung Lee, Wonpyo Park, Nicole Mitchell, Jonathan Pilault, Johan S. Obando-Ceron, Han-Byul Kim, Namhoon Lee, Elias Frantar, Yun Long, Amir Yazdanbakhsh, Shivani Agrawal, Suvinay Subramanian, Xin Wang, Sheng-Chun Kao, Xingyao Zhang, Trevor Gale, Aart Bik, Woohyun Han, Milen Ferev, Zhonglin Han, Hong-Seok Kim, Yann N. Dauphin, Karolina Dziugaite, Pablo Samuel Castro, Utku Evci
JaxPruner: A concise library for sparsity research. CoRR (2023)
Elias Frantar, Carlos Riquelme, Neil Houlsby, Dan Alistarh, Utku Evci
Scaling Laws for Sparsely-Connected Foundation Models. CoRR (2023)
Mike Lasby, Anna Golubeva, Utku Evci, Mihai Nica, Yani A. Ioannou
Dynamic Sparse Training with Structured Sparsity. CoRR (2023)
Mostafa Dehghani, Josip Djolonga, Basil Mustafa, Piotr Padlewski, Jonathan Heek, Justin Gilmer, Andreas Peter Steiner, Mathilde Caron, Robert Geirhos, Ibrahim Alabdulmohsin, Rodolphe Jenatton, Lucas Beyer, Michael Tschannen, Anurag Arnab, Xiao Wang, Carlos Riquelme Ruiz, Matthias Minderer, Joan Puigcerver, Utku Evci, Manoj Kumar, Sjoerd van Steenkiste, Gamaleldin Fathy Elsayed, Aravindh Mahendran, Fisher Yu, Avital Oliver, Fantine Huot, Jasmijn Bastings, Mark Collier, Alexey A. Gritsenko, Vighnesh Birodkar, Cristina Nader Vasconcelos, Yi Tay, Thomas Mensink, Alexander Kolesnikov, Filip Pavetic, Dustin Tran, Thomas Kipf, Mario Lucic, Xiaohua Zhai, Daniel Keysers, Jeremiah J. Harmsen, Neil Houlsby
Scaling Vision Transformers to 22 Billion Parameters. ICML (2023)
Utku Evci, Bart van Merrienboer, Thomas Unterthiner, Fabian Pedregosa, Max Vladymyrov
GradMax: Growing Neural Networks using Gradient Information. ICLR (2022)
Laura Graesser, Utku Evci, Erich Elsen, Pablo Samuel Castro
The State of Sparse Training in Deep Reinforcement Learning. ICML (2022)
Utku Evci, Vincent Dumoulin, Hugo Larochelle, Michael C. Mozer
Head2Toe: Utilizing Intermediate Representations for Better Transfer Learning. ICML (2022)
Utku Evci, Max Vladymyrov, Thomas Unterthiner, Bart van Merriënboer, Fabian Pedregosa
GradMax: Growing Neural Networks using Gradient Information. CoRR (2022)
Laura Graesser, Utku Evci, Erich Elsen, Pablo Samuel Castro
The State of Sparse Training in Deep Reinforcement Learning. CoRR (2022)
Utku Evci, Vincent Dumoulin, Hugo Larochelle, Michael C. Mozer
Head2Toe: Utilizing Intermediate Representations for Better Transfer Learning. CoRR (2022)
Sheng-Chun Kao, Amir Yazdanbakhsh, Suvinay Subramanian, Shivani Agrawal, Utku Evci, Tushar Krishna
Training Recipe for N: M Structured Sparsity with Decaying Pruning Mask. CoRR (2022)
Utku Evci, Yani Ioannou, Cem Keskin, Yann N. Dauphin
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win. AAAI (2022)
Vincent Dumoulin, Neil Houlsby, Utku Evci, Xiaohua Zhai, Ross Goroshin, Sylvain Gelly, Hugo Larochelle
Comparing Transfer and Meta Learning Approaches on a Unified Few-Shot Classification Benchmark. CoRR (2021)
Vincent Dumoulin, Neil Houlsby, Utku Evci, Xiaohua Zhai, Ross Goroshin, Sylvain Gelly, Hugo Larochelle
A Unified Few-Shot Classification Benchmark to Compare Transfer and Meta Learning Approaches. NeurIPS Datasets and Benchmarks (2021)
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
Practical Real Time Recurrent Learning with a Sparse Approximation. ICLR (2021)
Jacob Menick, Erich Elsen, Utku Evci, Simon Osindero, Karen Simonyan, Alex Graves
A Practical Sparse Approximation for Real Time Recurrent Learning. CoRR (2020)
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen
Rigging the Lottery: Making All Tickets Winners. ICML (2020)
Eleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin, Utku Evci, Kelvin Xu, Ross Goroshin, Carles Gelada, Kevin Swersky, Pierre-Antoine Manzagol, Hugo Larochelle
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples. ICLR (2020)
Utku Evci, Yani Andrew Ioannou, Cem Keskin, Yann N. Dauphin
Gradient Flow in Sparse Neural Networks and How Lottery Tickets Win. CoRR (2020)
Lakshay Sharma, Laura Graesser, Nikita Nangia, Utku Evci
Natural Language Understanding with the Quora Question Pairs Dataset. CoRR (2019)
Utku Evci, Fabian Pedregosa, Aidan N. Gomez, Erich Elsen
The Difficulty of Training Sparse Neural Networks. CoRR (2019)
Utku Evci, Trevor Gale, Jacob Menick, Pablo Samuel Castro, Erich Elsen
Rigging the Lottery: Making All Tickets Winners. CoRR (2019)
Utku Evci
Detecting Dead Weights and Units in Neural Networks. CoRR (2018)
Levent Sagun, Utku Evci, V. Ugur Güney, Yann N. Dauphin, Léon Bottou
Empirical Analysis of the Hessian of Over-Parametrized Neural Networks. ICLR (Workshop) (2018)
Levent Sagun, Utku Evci, V. Ugur Güney, Yann N. Dauphin, Léon Bottou
Empirical Analysis of the Hessian of Over-Parametrized Neural Networks. CoRR (2017)
Ronan Boulic, Utku Evci, Eray Molla, Phanindra Pisupati
One Step from the Locomotion to the Stepping Pattern. CASA (2016)