Shiwei Liu

Publication Activity (10 Years)

Years Active: 2024-2024
Publications (10 Years): 7

Top Topics

Minimization Problems

Matrix Decomposition

Rank Constraint

Top Venues

Publications

Arinbjorn Kolbeinsson, Kyle O'Brien, Tianjin Huang, Shanghua Gao, Shiwei Liu, Jonathan Richard Schwarz, Anurag Vaidya, Faisal Mahmood, Marinka Zitnik, Tianlong Chen, Thomas Hartvigsen
Composable Interventions for Language Models. CoRR (2024)
Zhenyu Zhang, Ajay Jaiswal, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients. CoRR (2024)
Tianjin Huang, Meng Fang, Li Shen, Fan Liu, Yulong Pei, Mykola Pechenizkiy, Shiwei Liu, Tianlong Chen
(PASS) Visual Prompt Locates Good Structure Sparsity through a Recurrent HyperNetwork. CoRR (2024)
Yuxin Zhang, Lirui Zhao, Mingbao Lin, Yunyun Sun, Yiwu Yao, Xingjia Han, Jared Tanner, Shiwei Liu, Rongrong Ji
Dynamic Sparse No Training: Training-Free Fine-tuning for Sparse LLMs. ICLR (2024)
Enneng Yang, Zhenyi Wang, Li Shen, Shiwei Liu, Guibing Guo, Xingwei Wang, Dacheng Tao
AdaMerging: Adaptive Model Merging for Multi-Task Learning. ICLR (2024)
Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. CoRR (2024)
Gen Li, Lu Yin, Jie Ji, Wei Niu, Minghai Qin, Bin Ren, Linke Guo, Shiwei Liu, Xiaolong Ma
NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization. ICLR (2024)