Mohammad Rastegari

ORCID

Publication Activity (10 Years)

Years Active: 2008-2024
Publications (10 Years): 91

Top Venues

CoRR

CVPR

ICLR

Trans. Mach. Learn. Res.

University of Maryland, College Park, MD, USA (PHD)

Education History

University of Maryland, College Park, MD, USA

PHD

Publications

Minsik Cho, Mohammad Rastegari, Devang Naik
KV-Runahead: Scalable Causal LLM Inference by Parallel Key-Value Cache Generation. CoRR (2024)
Minsik Cho, Keivan Alizadeh-Vahid, Qichen Fu, Saurabh Adya, Carlo C. del Mundo, Mohammad Rastegari, Devang Naik, Peter Zatloukal
eDKM: An Efficient and Accurate Train-Time Weight Clustering for Large Language Models. IEEE Comput. Archit. Lett. 23 (1) (2024)
Nikhil Bhendawade, Irina Belousova, Qichen Fu, Henry Mason, Mohammad Rastegari, Mahyar Najibi
Speculative Streaming: Fast LLM Inference without Auxiliary Models. CoRR (2024)
Maxwell Horton, Sachin Mehta, Ali Farhadi, Mohammad Rastegari
Bytes Are All You Need: Transformers Operating Directly On File Bytes. Trans. Mach. Learn. Res. 2024 (2024)
Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta
CLIP meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement. Trans. Mach. Learn. Res. 2024 (2024)
Qichen Fu, Minsik Cho, Thomas Merth, Sachin Mehta, Mohammad Rastegari, Mahyar Najibi
LazyLLM: Dynamic Token Pruning for Efficient Long Context LLM Inference. CoRR (2024)
Seyed-Iman Mirzadeh, Keivan Alizadeh-Vahid, Sachin Mehta, Carlo C. del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models. ICLR (2024)
Sachin Mehta, Maxwell Horton, Fartash Faghri, Mohammad Hossein Sekhavat, Mahyar Najibi, Mehrdad Farajtabar, Oncel Tuzel, Mohammad Rastegari
CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data. CoRR (2024)
Thomas Merth, Qichen Fu, Mohammad Rastegari, Mahyar Najibi
Superposition Prompting: Improving and Accelerating Retrieval-Augmented Generation. CoRR (2024)
Keivan Alizadeh, Seyed-Iman Mirzadeh, Dmitry Belenko, S. Khatamifard, Minsik Cho, Carlo C. del Mundo, Mohammad Rastegari, Mehrdad Farajtabar
LLM in a flash: Efficient Large Language Model Inference with Limited Memory. ACL (1) (2024)
Sachin Mehta, Mohammad Hossein Sekhavat, Qingqing Cao, Maxwell Horton, Yanzi Jin, Chenfan Sun, Seyed-Iman Mirzadeh, Mahyar Najibi, Dmitry Belenko, Peter Zatloukal, Mohammad Rastegari
OpenELM: An Efficient Language Model Family with Open Training and Inference Framework. CoRR (2024)
Raviteja Vemulapalli, Hadi Pouransari, Fartash Faghri, Sachin Mehta, Mehrdad Farajtabar, Mohammad Rastegari, Oncel Tuzel
Label-efficient Training of Small Task-specific Models by Leveraging Vision Foundation Models. CoRR (2023)
Elvis Nunez, Yanzi Jin, Mohammad Rastegari, Sachin Mehta, Maxwell Horton
Diffusion Models as Masked Audio-Video Learners. CoRR (2023)
Maxwell Horton, Sachin Mehta, Ali Farhadi, Mohammad Rastegari
Bytes Are All You Need: Transformers Operating Directly On File Bytes. CoRR (2023)
Sachin Mehta, Mohammad Rastegari
Separable Self-attention for Mobile Vision Transformers. Trans. Mach. Learn. Res. 2023 (2023)
Dmitrii Marin, Jen-Hao Rick Chang, Anurag Ranjan, Anish Prabhu, Mohammad Rastegari, Oncel Tuzel
Token Pooling in Vision Transformers for Image Classification. WACV (2023)
Haoxiang Wang, Pavan Kumar Anasosalu Vasu, Fartash Faghri, Raviteja Vemulapalli, Mehrdad Farajtabar, Sachin Mehta, Mohammad Rastegari, Oncel Tuzel, Hadi Pouransari
SAM-CLIP: Merging Vision Foundation Models towards Semantic and Spatial Understanding. CoRR (2023)
Fartash Faghri, Hadi Pouransari, Sachin Mehta, Mehrdad Farajtabar, Ali Farhadi, Mohammad Rastegari, Oncel Tuzel
Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement. CoRR (2023)
Elvis Nunez, Thomas Merth, Anish Prabhu, Mehrdad Farajtabar, Mohammad Rastegari, Sachin Mehta, Maxwell Horton
On the Efficacy of Multi-scale Data Samplers for Vision Applications. CoRR (2023)
Mohammadreza Salehi, Mehrdad Farajtabar, Maxwell Horton, Fartash Faghri, Hadi Pouransari, Raviteja Vemulapalli, Oncel Tuzel, Ali Farhadi, Mohammad Rastegari, Sachin Mehta
CLIP meets Model Zoo Experts: Pseudo-Supervision for Visual Enhancement. CoRR (2023)
Iman Mirzadeh, Keivan Alizadeh, Sachin Mehta, Carlo C. Del Mundo, Oncel Tuzel, Golnoosh Samei, Mohammad Rastegari, Mehrdad Farajtabar
ReLU Strikes Back: Exploiting Activation Sparsity in Large Language Models. CoRR (2023)
Duc N. M. Hoang, Minsik Cho, Thomas Merth, Mohammad Rastegari, Zhangyang Wang
(Dynamic) Prompting might be all you need to repair Compressed LLMs. CoRR (2023)
Keivan Alizadeh, Iman Mirzadeh, Dmitry Belenko, Karen Khatamifard, Minsik Cho, Carlo C. Del Mundo, Mohammad Rastegari, Mehrdad Farajtabar
LLM in a flash: Efficient Large Language Model Inference with Limited Memory. CoRR (2023)
Fartash Faghri, Hadi Pouransari, Sachin Mehta, Mehrdad Farajtabar, Ali Farhadi, Mohammad Rastegari, Oncel Tuzel
Reinforce Data, Multiply Impact: Improved Model Accuracy and Robustness with Dataset Reinforcement. ICCV (2023)
Minsik Cho, Keivan Alizadeh-Vahid, Qichen Fu, Saurabh Adya, Carlo C. Del Mundo, Mohammad Rastegari, Devang Naik, Peter Zatloukal
eDKM: An Efficient and Accurate Train-time Weight Clustering for Large Language Models. CoRR (2023)
Mohammad Samragh, Mehrdad Farajtabar, Sachin Mehta, Raviteja Vemulapalli, Fartash Faghri, Devang Naik, Oncel Tuzel, Mohammad Rastegari
Weight subcloning: direct initialization of transformers using larger pretrained ones. CoRR (2023)
Sachin Mehta, Farzad Abdolhosseini, Mohammad Rastegari
CVNets: High Performance Library for Computer Vision. CoRR (2022)
Chien-Yu Lin, Anish Prabhu, Thomas Merth, Sachin Mehta, Anurag Ranjan, Maxwell Horton, Mohammad Rastegari
SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks. ECCV (11) (2022)
Sachin Mehta, Hannaneh Hajishirzi, Mohammad Rastegari
DiCENet: Dimension-Wise Convolutions for Efficient Networks. IEEE Trans. Pattern Anal. Mach. Intell. 44 (5) (2022)
Minsik Cho, Keivan Alizadeh-Vahid, Saurabh Adya, Mohammad Rastegari
DKM: Differentiable k-Means Clustering Layer for Neural Network Compression. ICLR (2022)
Sachin Mehta, Saeid Naderiparizi, Fartash Faghri, Maxwell Horton, Lailin Chen, Ali Farhadi, Oncel Tuzel, Mohammad Rastegari
RangeAugment: Efficient Online Augmentation with Range Learning. CoRR (2022)
Chien-Yu Lin, Anish Prabhu, Thomas Merth, Sachin Mehta, Anurag Ranjan, Maxwell Horton, Mohammad Rastegari
SPIN: An Empirical Evaluation on Sharing Parameters of Isotropic Networks. CoRR (2022)
Sachin Mehta, Mohammad Rastegari
Separable Self-attention for Mobile Vision Transformers. CoRR (2022)
Maxwell Horton, Yanzi Jin, Ali Farhadi, Mohammad Rastegari
Layer-Wise Data-Free CNN Compression. ICPR (2022)
Sachin Mehta, Mohammad Rastegari
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer. ICLR (2022)
Sachin Mehta, Farzad Abdolhosseini, Mohammad Rastegari
CVNets: High Performance Library for Computer Vision. ACM Multimedia (2022)
Mitchell Wortsman, Maxwell Horton, Carlos Guestrin, Ali Farhadi, Mohammad Rastegari
Learning Neural Network Subspaces. CoRR (2021)
Sachin Mehta, Mohammad Rastegari
MobileViT: Light-weight, General-purpose, and Mobile-friendly Vision Transformer. CoRR (2021)
Elvis Nunez, Maxwell Horton, Anish Prabhu, Anurag Ranjan, Ali Farhadi, Mohammad Rastegari
LCS: Learning Compressible Subspaces for Adaptive Network Compression at Inference Time. CoRR (2021)
Minsik Cho, Keivan Alizadeh-Vahid, Saurabh Adya, Mohammad Rastegari
DKM: Differentiable K-Means Clustering Layer for Neural Network Compression. CoRR (2021)
Mitchell Wortsman, Maxwell Horton, Carlos Guestrin, Ali Farhadi, Mohammad Rastegari
Learning Neural Network Subspaces. ICML (2021)
Dmitrii Marin, Jen-Hao Rick Chang, Anurag Ranjan, Anish Prabhu, Mohammad Rastegari, Oncel Tuzel
Token Pooling in Vision Transformers. CoRR (2021)
Vivek Ramanujan, Mitchell Wortsman, Aniruddha Kembhavi, Ali Farhadi, Mohammad Rastegari
What's Hidden in a Randomly Weighted Neural Network? CVPR (2020)
Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi
DeFINE: Deep Factorized Input Token Embeddings for Neural Sequence Modeling. ICLR (2020)
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi
Enabling AI at the edge with XNOR-networks. Commun. ACM 63 (12) (2020)
Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, Ali Farhadi
Supermasks in Superposition. CoRR (2020)
Mitchell Wortsman, Vivek Ramanujan, Rosanne Liu, Aniruddha Kembhavi, Mohammad Rastegari, Jason Yosinski, Ali Farhadi
Supermasks in Superposition. NeurIPS (2020)
Maxwell Horton, Yanzi Jin, Ali Farhadi, Mohammad Rastegari
Layer-Wise Data-Free CNN Compression. CoRR (2020)
Keivan Alizadeh-Vahid, Anish Prabhu, Ali Farhadi, Mohammad Rastegari
Butterfly Transform: An Efficient FFT Based Neural Architecture Design. CVPR (2020)
Vivek Ramanujan, Mitchell Wortsman, Aniruddha Kembhavi, Ali Farhadi, Mohammad Rastegari
What's Hidden in a Randomly Weighted Neural Network? CoRR (2019)
Keivan Alizadeh, Ali Farhadi, Mohammad Rastegari
Butterfly Transform: An Efficient FFT Based Neural Architecture Design. CoRR (2019)
Sachin Mehta, Hannaneh Hajishirzi, Mohammad Rastegari
DiCENet: Dimension-wise Convolutions for Efficient Networks. CoRR (2019)
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan L. Yuille, Mohammad Rastegari
ELASTIC: Improving CNNs With Dynamic Scaling Policies. CVPR (2019)
Kenneth Marino, Mohammad Rastegari, Ali Farhadi, Roozbeh Mottaghi
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge. CVPR (2019)
Unnat Jain, Luca Weihs, Eric Kolve, Mohammad Rastegari, Svetlana Lazebnik, Ali Farhadi, Alexander G. Schwing, Aniruddha Kembhavi
Two Body Problem: Collaborative Visual Task Completion. CoRR (2019)
Unnat Jain, Luca Weihs, Eric Kolve, Mohammad Rastegari, Svetlana Lazebnik, Ali Farhadi, Alexander G. Schwing, Aniruddha Kembhavi
Two Body Problem: Collaborative Visual Task Completion. CVPR (2019)
Mohammad Mahdi Derakhshani, Saeed Masoudnia, Amir Hossein Shaker, Omid Mersa, Mohammad Amin Sadeghi, Mohammad Rastegari, Babak Nadjar Araabi
Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors. CVPR (2019)
Mitchell Wortsman, Ali Farhadi, Mohammad Rastegari
Discovering Neural Wirings. NeurIPS (2019)
Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi
DeFINE: DEep Factorized INput Word Embeddings for Neural Sequence Modeling. CoRR (2019)
Kenneth Marino, Mohammad Rastegari, Ali Farhadi, Roozbeh Mottaghi
OK-VQA: A Visual Question Answering Benchmark Requiring External Knowledge. CoRR (2019)
Mohammad Mahdi Derakhshani, Saeed Masoudnia, Amir Hossein Shaker, Omid Mersa, Mohammad Amin Sadeghi, Mohammad Rastegari, Babak Nadjar Araabi
Assisted Excitation of Activations: A Learning Technique to Improve Object Detectors. CoRR (2019)
Mitchell Wortsman, Kiana Ehsani, Mohammad Rastegari, Ali Farhadi, Roozbeh Mottaghi
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning. CVPR (2019)
Mitchell Wortsman, Ali Farhadi, Mohammad Rastegari
Discovering Neural Wirings. CoRR (2019)
Sachin Mehta, Mohammad Rastegari, Linda G. Shapiro, Hannaneh Hajishirzi
ESPNetv2: A Light-Weight, Power Efficient, and General Purpose Convolutional Neural Network. CVPR (2019)
Huiyu Wang, Aniruddha Kembhavi, Ali Farhadi, Alan L. Yuille, Mohammad Rastegari
ELASTIC: Improving CNNs with Instance Specific Scaling Policies. CoRR (2018)
Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi
Pyramidal Recurrent Unit for Language Modeling. EMNLP (2018)
Hessam Bagherinezhad, Maxwell Horton, Mohammad Rastegari, Ali Farhadi
Label Refinery: Improving ImageNet Classification through Label Progression. CoRR (2018)
Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, Ali Farhadi
IQA: Visual Question Answering in Interactive Environments. CVPR (2018)
Sachin Mehta, Mohammad Rastegari, Anat Caspi, Linda G. Shapiro, Hannaneh Hajishirzi
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation. ECCV (10) (2018)
Sachin Mehta, Mohammad Rastegari, Linda G. Shapiro, Hannaneh Hajishirzi
ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network. CoRR (2018)
Sachin Mehta, Rik Koncel-Kedziorski, Mohammad Rastegari, Hannaneh Hajishirzi
Pyramidal Recurrent Unit for Language Modeling. CoRR (2018)
Mitchell Wortsman, Kiana Ehsani, Mohammad Rastegari, Ali Farhadi, Roozbeh Mottaghi
Learning to Learn How to Learn: Self-Adaptive Visual Navigation Using Meta-Learning. CoRR (2018)
Sachin Mehta, Mohammad Rastegari, Anat Caspi, Linda G. Shapiro, Hannaneh Hajishirzi
ESPNet: Efficient Spatial Pyramid of Dilated Convolutions for Semantic Segmentation. CoRR (2018)
Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi
LCNN: Lookup-Based Convolutional Neural Network. CVPR (2017)
Daniel Gordon, Aniruddha Kembhavi, Mohammad Rastegari, Joseph Redmon, Dieter Fox, Ali Farhadi
IQA: Visual Question Answering in Interactive Environments. CoRR (2017)
Mahdyar Ravanbakhsh, Hossein Mousavi, Moin Nabi, Mohammad Rastegari, Carlo S. Regazzoni
CNN-aware Binary Map for General Semantic Segmentation. CoRR (2016)
Mahdyar Ravanbakhsh, Hossein Mousavi, Moin Nabi, Mohammad Rastegari, Carlo S. Regazzoni
CNN-aware binary MAP for general semantic segmentation. ICIP (2016)
Roozbeh Mottaghi, Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images. CVPR (2016)
Roozbeh Mottaghi, Mohammad Rastegari, Abhinav Gupta, Ali Farhadi
"What happens if..." Learning to Predict the Effect of Forces in Images. CoRR (2016)
Mahyar Najibi, Mohammad Rastegari, Larry S. Davis
G-CNN: An Iterative Grid Based Object Detector. CVPR (2016)
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. ECCV (4) (2016)
Mohammad Rastegari, Vicente Ordonez, Joseph Redmon, Ali Farhadi
XNOR-Net: ImageNet Classification Using Binary Convolutional Neural Networks. CoRR (2016)
Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi
LCNN: Lookup-based Convolutional Neural Network. CoRR (2016)
Roozbeh Mottaghi, Mohammad Rastegari, Abhinav Gupta, Ali Farhadi
"What Happens If..." Learning to Predict the Effect of Forces in Images. ECCV (4) (2016)
Mohammad Rastegari, Cem Keskin, Pushmeet Kohli, Shahram Izadi
Computationally bounded retrieval. CVPR (2015)
Mahyar Najibi, Mohammad Rastegari, Larry S. Davis
On Large-Scale Retrieval: Binary or n-ary Coding? CoRR (2015)
Mahdyar Ravanbakhsh, Hossein Mousavi, Mohammad Rastegari, Vittorio Murino, Larry S. Davis
Action Recognition with Image Based CNN Features. CoRR (2015)
Ashish Shrivastava, Mohammad Rastegari, Sumit Shekhar, Rama Chellappa, Larry S. Davis
Class consistent multi-modal fusion with binary features. CVPR (2015)
Roozbeh Mottaghi, Hessam Bagherinezhad, Mohammad Rastegari, Ali Farhadi
Newtonian Image Understanding: Unfolding the Dynamics of Objects in Static Images. CoRR (2015)
Mahyar Najibi, Mohammad Rastegari, Larry S. Davis
G-CNN: an Iterative Grid Based Object Detector. CoRR (2015)
Mohammad Rastegari, Hannaneh Hajishirzi, Ali Farhadi
Discriminative and consistent similarities in instance-level Multiple Instance Learning. CVPR (2015)
Mohammad Rastegari, Shobeir Fakhraei, Jonghyun Choi, David W. Jacobs, Larry S. Davis
Comparing apples to apples in the evaluation of binary coding methods. CoRR (2014)
Fatemeh Mirrashed, Mohammad Rastegari
Domain Adaptive Classification. ICCV (2013)
Mohammad Rastegari, Jonghyun Choi, Shobeir Fakhraei, Hal Daumé III, Larry S. Davis
Predictable Dual-View Hashing. ICML (3) (2013)
Jonghyun Choi, Mohammad Rastegari, Ali Farhadi, Larry S. Davis
Adding Unlabeled Samples to Categories by Learned Attributes. CVPR (2013)
Mohammad Rastegari, Ali Diba, Devi Parikh, Ali Farhadi
Multi-attribute Queries: To Merge or Not to Merge? CVPR (2013)
Hannaneh Hajishirzi, Mohammad Rastegari, Ali Farhadi, Jessica K. Hodgins
Semantic Understanding of Professional Soccer Commentaries. UAI (2012)
Hannaneh Hajishirzi, Mohammad Rastegari, Ali Farhadi, Jessica K. Hodgins
Semantic Understanding of Professional Soccer Commentaries CoRR (2012)
Mohammad Rastegari, Ali Farhadi, David A. Forsyth
Attribute Discovery via Predictable Discriminative Binary Codes. ECCV (6) (2012)
Mohammad Rastegari, Chen Fang, Lorenzo Torresani
Scalable object-class retrieval with approximate and top-k ranking. ICCV (2011)

Mohammad Rastegari.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Mohammad Rastegari