Mark Kurtz

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 9

Top Topics

Transfer Learning

Language Modelling

Top Venues

Publications

Abhinav Agarwalla, Abhay Gupta, Alexandre Marques, Shubhra Pandit, Michael Goin, Eldar Kurtic, Kevin Leong, Tuan Nguyen, Mahmoud Salem, Dan Alistarh, Sean Lie, Mark Kurtz
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment. CoRR (2024)
Daniel Campos, Alexandre Marques, Mark Kurtz, ChengXiang Zhai
oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes. SustaiNLP (2023)
Daniel Campos, Alexandre Marques, Mark Kurtz, ChengXiang Zhai
oBERTa: Improving Sparse Transfer Learning via improved initialization, distillation, and pruning regimes. CoRR (2023)
Daniel Campos, Alexandre Marques, Tuan Nguyen, Mark Kurtz, ChengXiang Zhai
Sparse*BERT: Sparse Models are Robust. CoRR (2022)
Eldar Kurtic, Daniel Campos, Tuan Nguyen, Elias Frantar, Mark Kurtz, Benjamin Fineran, Michael Goin, Dan Alistarh
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models. CoRR (2022)
Eugenia Iofinova, Alexandra Peste, Mark Kurtz, Dan Alistarh
How Well Do Sparse ImageNet Models Transfer? CVPR (2022)
Eldar Kurtic, Daniel Campos, Tuan Nguyen, Elias Frantar, Mark Kurtz, Benjamin Fineran, Michael Goin, Dan Alistarh
The Optimal BERT Surgeon: Scalable and Accurate Second-Order Pruning for Large Language Models. EMNLP (2022)
Eugenia Iofinova, Alexandra Peste, Mark Kurtz, Dan Alistarh
How Well Do Sparse Imagenet Models Transfer? CoRR (2021)
Mark Kurtz, Justin Kopinsky, Rati Gelashvili, Alexander Matveev, John Carr, Michael Goin, William M. Leiserson, Sage Moore, Nir Shavit, Dan Alistarh
Inducing and Exploiting Activation Sparsity for Fast Inference on Deep Neural Networks. ICML (2020)