Saleh Ashkboos

Publication Activity (10 Years)

Years Active: 2017-2024
Publications (10 Years): 27

Top Topics

Matrix Multiplication

Weather Forecast

Top Venues

Publications

Saleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, Bo Li, Martin Jaggi, Dan Alistarh, Torsten Hoefler, James Hensman
QuaRot: Outlier-Free 4-Bit Inference in Rotated LLMs. CoRR (2024)
Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression. ICLR (2024)
Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman
SliceGPT: Compress Large Language Models by Deleting Rows and Columns. ICLR (2024)
Saleh Ashkboos, Maximilian L. Croci, Marcelo Gennari Do Nascimento, Torsten Hoefler, James Hensman
SliceGPT: Compress Large Language Models by Deleting Rows and Columns. CoRR (2024)
Lukas Gianinazzi, Alexandros Nikolaos Ziogas, Langwen Huang, Piotr Luczynski, Saleh Ashkboos, Florian Scheidl, Armon Carigiet, Chio Ge, Nabil Abubaker, Maciej Besta, Tal Ben-Nun, Torsten Hoefler
Arrow Matrix Decomposition: A Novel Approach for Communication-Efficient Sparse Matrix Multiplication. CoRR (2024)
Tim Dettmers, Ruslan Svirschevski, Vage Egiazarian, Denis Kuznedelev, Elias Frantar, Saleh Ashkboos, Alexander Borzunov, Torsten Hoefler, Dan Alistarh
SpQR: A Sparse-Quantized Representation for Near-Lossless LLM Weight Compression. CoRR (2023)
Saleh Ashkboos, Ilia Markov, Elias Frantar, Tingxuan Zhong, Xincheng Wang, Jie Ren, Torsten Hoefler, Dan Alistarh
Towards End-to-end 4-Bit Inference on Generative Large Language Models. CoRR (2023)
Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
OPTQ: Accurate Quantization for Generative Pre-trained Transformers. ICLR (2023)
Andrei Ivanov, Nikoli Dryden, Tal Ben-Nun, Saleh Ashkboos, Torsten Hoefler
STen: Productive and Efficient Sparsity in PyTorch. CoRR (2023)
Lukas Gianinazzi, Tal Ben-Nun, Saleh Ashkboos, Yves Baumann, Piotr Luczynski, Torsten Hoefler
The spatial computer: A model for energy-efficient parallel computation. CoRR (2022)
Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler
Motif Prediction with Graph Neural Networks. KDD (2022)
Elias Frantar, Saleh Ashkboos, Torsten Hoefler, Dan Alistarh
GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers. CoRR (2022)
Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler
ENS-10: A Dataset For Post-Processing Ensemble Weather Forecasts. NeurIPS (2022)
Maciej Besta, Cesare Miglioli, Paolo Sylos Labini, Jakub Tetek, Patrick Iff, Raghavendra Kanakagiri, Saleh Ashkboos, Kacper Janda, Michal Podstawski, Grzegorz Kwasniewski, Niels Gleinig, Flavio Vella, Onur Mutlu, Torsten Hoefler
ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations. CoRR (2022)
Maciej Besta, Cesare Miglioli, Paolo Sylos Labini, Jakub Tetek, Patrick Iff, Raghavendra Kanakagiri, Saleh Ashkboos, Kacper Janda, Michal Podstawski, Grzegorz Kwasniewski, Niels Gleinig, Flavio Vella, Onur Mutlu, Torsten Hoefler
ProbGraph: High-Performance and High-Accuracy Graph Mining with Probabilistic Set Representations. SC (2022)
Saleh Ashkboos, Langwen Huang, Nikoli Dryden, Tal Ben-Nun, Peter Dueben, Lukas Gianinazzi, Luca Kummer, Torsten Hoefler
ENS-10: A Dataset For Post-Processing Ensemble Weather Forecast. CoRR (2022)
Maciej Besta, Raphael Grob, Cesare Miglioli, Nicola Bernold, Grzegorz Kwasniewski, Gabriel Gjini, Raghavendra Kanakagiri, Saleh Ashkboos, Lukas Gianinazzi, Nikoli Dryden, Torsten Hoefler
Motif Prediction with Graph Neural Networks. CoRR (2021)
Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler
Flare: Flexible In-Network Allreduce. CoRR (2021)
Daniele De Sensi, Salvatore Di Girolamo, Saleh Ashkboos, Shigang Li, Torsten Hoefler
Flare: flexible in-network allreduce. SC (2021)
Milad Aghajohari, Mohammad Sadegh Akhondzadeh, Saleh Ashkboos, Kamran Chitsaz
Degree-based Feature Is All You Need: Science4Cast Report. IEEE BigData (2021)
Peter Davies, Vijaykrishna Gurunanthan, Niusha Moshrefi, Saleh Ashkboos, Dan Alistarh
New Bounds For Distributed Mean Estimation and Variance Reduction. ICLR (2021)
Ramin Javadi, Saleh Ashkboos
Multi-way sparsest cut problem on trees with a control on the number of parts and outliers. Discret. Appl. Math. 289 (2021)
Dan Alistarh, Saleh Ashkboos, Peter Davies
Distributed Mean Estimation with Optimal Error Bounds. CoRR (2020)
Cédric Renggli, Saleh Ashkboos, Mehdi Aghagolzadeh, Dan Alistarh, Torsten Hoefler
SparCML: high-performance sparse communication for machine learning. SC (2019)
Ramin Javadi, Saleh Ashkboos
Multi-way sparsest cut problem on trees with a control on the number of parts and outliers. CoRR (2017)
Ramin Javadi, Saleh Ashkboos
An Efficient Parallel Data Clustering Algorithm Using Isoperimetric Number of Trees. CoRR (2017)
Saleh Ashkboos, Gholam Reza Omidi, Fateme Shafiei, Khosro Tajbakhsh
Minimum Cuts of Distance-Regular Digraphs. Electron. J. Comb. 24 (4) (2017)