Zechun Liu

Publication Activity (10 Years)

Years Active: 2016-2024
Publications (10 Years): 70

Top Topics

Continuous Optimization

Uniform Quantization

Top Venues

Publications

Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng
RoLoRA: Fine-tuning Rotated Outlier-free LLMs for Effective Weight-Activation Quantization. CoRR (2024)
Zechun Liu, Barlas Oguz, Changsheng Zhao, Ernie Chang, Pierre Stock, Yashar Mehdad, Yangyang Shi, Raghuraman Krishnamoorthi, Vikas Chandra
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models. ACL (Findings) (2024)
Zechun Liu, Changsheng Zhao, Forrest N. Iandola, Chen Lai, Yuandong Tian, Igor Fedorov, Yunyang Xiong, Ernie Chang, Yangyang Shi, Raghuraman Krishnamoorthi, Liangzhen Lai, Vikas Chandra
MobileLLM: Optimizing Sub-billion Parameter Language Models for On-Device Use Cases. CoRR (2024)
Zechun Liu, Changsheng Zhao, Igor Fedorov, Bilge Soran, Dhruv Choudhary, Raghuraman Krishnamoorthi, Vikas Chandra, Yuandong Tian, Tijmen Blankevoort
SpinQuant: LLM quantization with learned rotations. CoRR (2024)
Florian Bordes, Richard Yuanzhe Pang, Anurag Ajay, Alexander C. Li, Adrien Bardes, Suzanne Petryk, Oscar Mañas, Zhiqiu Lin, Anas Mahmoud, Bargav Jayaraman, Mark Ibrahim, Melissa Hall, Yunyang Xiong, Jonathan Lebensold, Candace Ross, Srihari Jayakumar, Chuan Guo, Diane Bouchacourt, Haider Al-Tahan, Karthik Padthe, Vasu Sharma, Hu Xu, Xiaoqing Ellen Tan, Megan Richards, Samuel Lavoie, Pietro Astolfi, Reyhane Askari Hemmat, Jun Chen, Kushal Tirumala, Rim Assouel, Mazda Moayeri, Arjang Talattof, Kamalika Chaudhuri, Zechun Liu, Xilun Chen, Quentin Garrido, Karen Ullrich, Aishwarya Agrawal, Kate Saenko, Asli Celikyilmaz, Vikas Chandra
An Introduction to Vision-Language Modeling. CoRR (2024)
Ganesh Jawahar, Haichuan Yang, Yunyang Xiong, Zechun Liu, Dilin Wang, Fei Sun, Meng Li, Aasish Pappu, Barlas Oguz, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Raghuraman Krishnamoorthi, Vikas Chandra
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts. ACL (Findings) (2024)
Ernie Chang, Sidd Srinivasan, Mahi Luthra, Pin-Jie Lin, Varun Nagaraja, Forrest N. Iandola, Zechun Liu, Zhaoheng Ni, Changsheng Zhao, Yangyang Shi, Vikas Chandra
On the Open Prompt Challenge in Conditional Audio Generation. ICASSP (2024)
Xijie Huang, Zechun Liu, Shih-Yang Liu, Kwang-Ting Cheng
Efficient Quantization-aware Training with Adaptive Coreset Selection. CoRR (2023)
Ganesh Jawahar, Haichuan Yang, Yunyang Xiong, Zechun Liu, Dilin Wang, Fei Sun, Meng Li, Aasish Pappu, Barlas Oguz, Muhammad Abdul-Mageed, Laks V. S. Lakshmanan, Raghuraman Krishnamoorthi, Vikas Chandra
Mixture-of-Supernets: Improving Weight-Sharing Supernet Training with Architecture-Routed Mixture-of-Experts. CoRR (2023)
Zechun Liu, Barlas Oguz, Changsheng Zhao, Ernie Chang, Pierre Stock, Yashar Mehdad, Yangyang Shi, Raghuraman Krishnamoorthi, Vikas Chandra
LLM-QAT: Data-Free Quantization Aware Training for Large Language Models. CoRR (2023)
Zechun Liu, Barlas Oguz, Aasish Pappu, Yangyang Shi, Raghuraman Krishnamoorthi
Binary and Ternary Natural Language Generation. ACL (1) (2023)
Zechun Liu, Barlas Oguz, Aasish Pappu, Yangyang Shi, Raghuraman Krishnamoorthi
Binary and Ternary Natural Language Generation. CoRR (2023)
Shih-Yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng
LLM-FP4: 4-Bit Floating-Point Quantized Transformers. CoRR (2023)
Renjie Wei, Shuwen Zhang, Zechun Liu, Meng Li, Yuchen Fan, Runsheng Wang, Ru Huang
EBSR: Enhanced Binary Neural Network for Image Super-Resolution. CoRR (2023)
Shih-Yang Liu, Zechun Liu, Kwang-Ting Cheng
Oscillation-free Quantization for Low-bit Vision Transformers. ICML (2023)
Shih-Yang Liu, Zechun Liu, Xijie Huang, Pingcheng Dong, Kwang-Ting Cheng
LLM-FP4: 4-Bit Floating-Point Quantized Transformers. EMNLP (2023)
Shih-Yang Liu, Zechun Liu, Kwang-Ting Cheng
Oscillation-free Quantization for Low-bit Vision Transformers. CoRR (2023)
Jun Chen, Deyao Zhu, Xiaoqian Shen, Xiang Li, Zechun Liu, Pengchuan Zhang, Raghuraman Krishnamoorthi, Vikas Chandra, Yunyang Xiong, Mohamed Elhoseiny
MiniGPT-v2: large language model as a unified interface for vision-language multi-task learning. CoRR (2023)
Ernie Chang, Sidd Srinivasan, Mahi Luthra, Pin-Jie Lin, Varun Nagaraja, Forrest N. Iandola, Zechun Liu, Zhaoheng Ni, Changsheng Zhao, Yangyang Shi, Vikas Chandra
On The Open Prompt Challenge In Conditional Audio Generation. CoRR (2023)
Arnav Chavan, Zhiqiang Shen, Zhuang Liu, Zechun Liu, Kwang-Ting Cheng, Eric P. Xing
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space. CVPR (2022)
Zhiqiang Shen, Zechun Liu, Eric P. Xing
Sliced Recursive Transformer. ECCV (24) (2022)
Xijie Huang, Zhiqiang Shen, Shichao Li, Zechun Liu, Xianghong Hu, Jeffry Wicaksana, Eric P. Xing, Kwang-Ting Cheng
SDQ: Stochastic Differentiable Quantization with Mixed Precision. ICML (2022)
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad
BiT: Robustly Binarized Multi-distilled Transformer. CoRR (2022)
Xijie Huang, Zhiqiang Shen, Shichao Li, Zechun Liu, Xianghong Hu, Jeffry Wicaksana, Eric P. Xing, Kwang-Ting Cheng
SDQ: Stochastic Differentiable Quantization with Mixed Precision. CoRR (2022)
Arnav Chavan, Zhiqiang Shen, Zhuang Liu, Zechun Liu, Kwang-Ting Cheng, Eric P. Xing
Vision Transformer Slimming: Multi-Dimension Searching in Continuous Optimization Space. CoRR (2022)
Zechun Liu, Kwang-Ting Cheng, Dong Huang, Eric P. Xing, Zhiqiang Shen
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. CVPR (2022)
Shichao Li, Zechun Liu, Zhiqiang Shen, Kwang-Ting Cheng
Stereo Neural Vernier Caliper. CoRR (2022)
Zhiqiang Shen, Zechun Liu, Zhuang Liu, Marios Savvides, Trevor Darrell, Eric Po Xing
Un-mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning. AAAI (2022)
Shichao Li, Zechun Liu, Zhiqiang Shen, Kwang-Ting Cheng
Stereo Neural Vernier Caliper. AAAI (2022)
Zechun Liu, Zhiqiang Shen, Yun Long, Eric P. Xing, Kwang-Ting Cheng, Chas Leichner
Data-Free Neural Architecture Search via Recursive Label Calibration. ECCV (24) (2022)
Zechun Liu, Barlas Oguz, Aasish Pappu, Lin Xiao, Scott Yih, Meng Li, Raghuraman Krishnamoorthi, Yashar Mehdad
BiT: Robustly Binarized Multi-distilled Transformer. NeurIPS (2022)
Yun Li, Zechun Liu, Weiqun Wu, Haotian Yao, Xiangyu Zhang, Chi Zhang, Baoqun Yin
Weight-Dependent Gates for Network Pruning. IEEE Trans. Circuits Syst. Video Technol. 32 (10) (2022)
Zhiqiang Shen, Zechun Liu, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides
Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study. CoRR (2021)
Zhiqiang Shen, Zechun Liu, Eric P. Xing
Sliced Recursive Transformer. CoRR (2021)
Zechun Liu, Kwang-Ting Cheng, Dong Huang, Eric P. Xing, Zhiqiang Shen
Nonuniform-to-Uniform Quantization: Towards Accurate Quantization via Generalized Straight-Through Estimation. CoRR (2021)
Zhiqiang Shen, Mingyang Huang, Jianping Shi, Zechun Liu, Harsh Maheshwari, Yutong Zheng, Xiangyang Xue, Marios Savvides, Thomas S. Huang
CDTD: A Large-Scale Cross-Domain Benchmark for Instance-Level Image-to-Image Translation and Domain Adaptive Object Detection. Int. J. Comput. Vis. 129 (3) (2021)
Zhiqiang Shen, Zechun Liu, Dejia Xu, Zitian Chen, Kwang-Ting Cheng, Marios Savvides
Is Label Smoothing Truly Incompatible with Knowledge Distillation: An Empirical Study. ICLR (2021)
Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
"BNN - BN = ?": Training Binary Neural Networks without Batch Normalization. CoRR (2021)
Zechun Liu, Zhiqiang Shen, Shichao Li, Koen Helwegen, Dong Huang, Kwang-Ting Cheng
How Do Adam and Training Strategies Help BNNs Optimization? CoRR (2021)
Zhiqiang Shen, Zechun Liu, Jie Qin, Marios Savvides, Kwang-Ting Cheng
Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learning. AAAI (2021)
Zhiqiang Shen, Zechun Liu, Jie Qin, Lei Huang, Kwang-Ting Cheng, Marios Savvides
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-Bit Neural Networks via Guided Distribution Calibration. CVPR (2021)
Zechun Liu, Zhiqiang Shen, Yun Long, Eric P. Xing, Kwang-Ting Cheng, Chas Leichner
Data-Free Neural Architecture Search via Recursive Label Calibration. CoRR (2021)
Zechun Liu, Zhiqiang Shen, Shichao Li, Koen Helwegen, Dong Huang, Kwang-Ting Cheng
How Do Adam and Training Strategies Help BNNs Optimization. ICML (2021)
Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang
"BNN - BN = ?": Training Binary Neural Networks Without Batch Normalization. CVPR Workshops (2021)
Zhiqiang Shen, Zechun Liu, Jie Qin, Marios Savvides, Kwang-Ting Cheng
Partial Is Better Than All: Revisiting Fine-tuning Strategy for Few-shot Learning. CoRR (2021)
Zechun Liu, Xiangyu Zhang, Zhiqiang Shen, Yichen Wei, Kwang-Ting Cheng, Jian Sun
Joint Multi-Dimension Pruning via Numerical Gradient Update. IEEE Trans. Image Process. 30 (2021)
Ellen Yi-Ge, Rui Fan, Zechun Liu, Zhiqiang Shen
Conditional Link Prediction of Category-Implicit Keypoint Detection. WACV (2021)
Zhiqiang Shen, Zechun Liu, Jie Qin, Lei Huang, Kwang-Ting Cheng, Marios Savvides
S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration. CoRR (2021)
Hai Phan, Zechun Liu, Dang Huynh, Marios Savvides, Kwang-Ting Cheng, Zhiqiang Shen
Binarizing MobileNet via Evolution-based Searching. CoRR (2020)
Devesh Walawalkar, Zhiqiang Shen, Zechun Liu, Marios Savvides
Attentive Cutmix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification. ICASSP (2020)
Ellen Yi-Ge, Rui Fan, Zechun Liu, Zhiqiang Shen
Conditional Link Prediction of Category-Implicit Keypoint Detection. CoRR (2020)
Devesh Walawalkar, Zhiqiang Shen, Zechun Liu, Marios Savvides
Attentive CutMix: An Enhanced Data Augmentation Approach for Deep Learning Based Image Classification. CoRR (2020)
Zechun Liu, Xiangyu Zhang, Zhiqiang Shen, Zhe Li, Yichen Wei, Kwang-Ting Cheng, Jian Sun
Joint Multi-Dimension Pruning. CoRR (2020)
Zichao Guo, Xiangyu Zhang, Haoyuan Mu, Wen Heng, Zechun Liu, Yichen Wei, Jian Sun
Single Path One-Shot Neural Architecture Search with Uniform Sampling. ECCV (16) (2020)
Zechun Liu, Zhiqiang Shen, Marios Savvides, Kwang-Ting Cheng
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions. CoRR (2020)
Zechun Liu, Zhiqiang Shen, Marios Savvides, Kwang-Ting Cheng
ReActNet: Towards Precise Binary Neural Network with Generalized Activation Functions. ECCV (14) (2020)
Yun Li, Weiqun Wu, Zechun Liu, Chi Zhang, Xiangyu Zhang, Haotian Yao, Baoqun Yin
Weight-dependent Gates for Network Pruning. CoRR (2020)
Hai Phan, Zechun Liu, Dang Huynh, Marios Savvides, Kwang-Ting Cheng, Zhiqiang Shen
Binarizing MobileNet via Evolution-Based Searching. CVPR (2020)
Zechun Liu, Wenhan Luo, Baoyuan Wu, Xin Yang, Wei Liu, Kwang-Ting Cheng
Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance. Int. J. Comput. Vis. 128 (1) (2020)
Zhiqiang Shen, Zechun Liu, Zhuang Liu, Marios Savvides, Trevor Darrell
Rethinking Image Mixture for Unsupervised Visual Representation Learning. CoRR (2020)
Yun Li, Weiqun Wu, Zechun Liu, Chi Zhang, Xiangyu Zhang, Haotian Yao, Baoqun Yin
Weight-Dependent Gates for Differentiable Neural Network Pruning. ECCV Workshops (5) (2020)
Zechun Liu, Haoyuan Mu, Xiangyu Zhang, Zichao Guo, Xin Yang, Kwang-Ting Cheng, Jian Sun
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning. ICCV (2019)
Koen Helwegen, James Widdicombe, Lukas Geiger, Zechun Liu, Kwang-Ting Cheng, Roeland Nusselder
Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization. CoRR (2019)
Zichao Guo, Xiangyu Zhang, Haoyuan Mu, Wen Heng, Zechun Liu, Yichen Wei, Jian Sun
Single Path One-Shot Neural Architecture Search with Uniform Sampling. CoRR (2019)
Koen Helwegen, James Widdicombe, Lukas Geiger, Zechun Liu, Kwang-Ting Cheng, Roeland Nusselder
Latent Weights Do Not Exist: Rethinking Binarized Neural Network Optimization. NeurIPS (2019)
Zechun Liu, Haoyuan Mu, Xiangyu Zhang, Zichao Guo, Xin Yang, Kwang-Ting (Tim) Cheng, Jian Sun
MetaPruning: Meta Learning for Automatic Neural Network Channel Pruning. CoRR (2019)
Zechun Liu, Baoyuan Wu, Wenhan Luo, Xin Yang, Wei Liu, Kwang-Ting Cheng
Bi-Real Net: Enhancing the Performance of 1-bit CNNs With Improved Representational Capability and Advanced Training Algorithm. CoRR (2018)
Zechun Liu, Baoyuan Wu, Wenhan Luo, Xin Yang, Wei Liu, Kwang-Ting Cheng
Bi-Real Net: Enhancing the Performance of 1-Bit CNNs with Improved Representational Capability and Advanced Training Algorithm. ECCV (15) (2018)
Zechun Liu, Wenhan Luo, Baoyuan Wu, Xin Yang, Wei Liu, Kwang-Ting Cheng
Bi-Real Net: Binarizing Deep Network Towards Real-Network Performance. CoRR (2018)
Bifang He, Guoshi Chai, Yaocong Duan, Zhiqiang Yan, Liuyang Qiu, Huixiong Zhang, Zechun Liu, Qiang He, Ke Han, Beibei Ru, Feng-Biao Guo, Hui Ding, Hao Lin, Xianlong Wang, Nini Rao, Peng Zhou, Jian Huang
BDB: biopanning data bank. Nucleic Acids Res. 44 (Database-Issue) (2016)