Kevin Leong

Publication Activity (10 Years)

Years Active: 2023-2024
Publications (10 Years): 4

Top Topics

Language Modelling

Term Dependencies

Top Venues

Publications

Abhinav Agarwalla, Abhay Gupta, Alexandre Marques, Shubhra Pandit, Michael Goin, Eldar Kurtic, Kevin Leong, Tuan Nguyen, Mahmoud Salem, Dan Alistarh, Sean Lie, Mark Kurtz
Enabling High-Sparsity Foundational Llama Models with Efficient Pretraining and Deployment. CoRR (2024)
Vithursan Thangarasa, Mahmoud Salem, Shreyas Saxena, Kevin Leong, Joel Hestness, Sean Lie
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models. CoRR (2024)
Vithursan Thangarasa, Abhay Gupta, William Marshall, Tianda Li, Kevin Leong, Dennis DeCoste, Sean Lie, Shreyas Saxena
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models. CoRR (2023)
Vithursan Thangarasa, Abhay Gupta, William Marshall, Tianda Li, Kevin Leong, Dennis DeCoste, Sean Lie, Shreyas Saxena
SPDF: Sparse Pre-training and Dense Fine-tuning for Large Language Models. UAI (2023)