Lu Yin

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 29

Top Topics

Supervised Feature Selection

Avoid Overfitting

Top Venues

Publications

Qiao Xiao, Pingchuan Ma, Adriana Fernandez-Lopez, Boqian Wu, Lu Yin, Stavros Petridis, Mykola Pechenizkiy, Maja Pantic, Decebal Constantin Mocanu, Shiwei Liu
Dynamic Data Pruning for Automatic Speech Recognition. CoRR (2024)
Ajay Jaiswal, Bodun Hu, Lu Yin, Yeonju Ro, Shiwei Liu, Tianlong Chen, Aditya Akella
FFN-SkipLLM: A Hidden Gem for Autoregressive Decoding with Adaptive Feed Forward Skipping. CoRR (2024)
Adriana Fernandez-Lopez, Honglie Chen, Pingchuan Ma, Lu Yin, Qiao Xiao, Stavros Petridis, Shiwei Liu, Maja Pantic
MSRS: Training Multimodal Speech Recognition Models from Scratch with Sparse Mask Optimization. CoRR (2024)
Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu
OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning. CoRR (2024)
Zhenyu Zhang, Ajay Jaiswal, Lu Yin, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients. CoRR (2024)
Ricky Maulana Fajri, Yulong Pei, Lu Yin, Mykola Pechenizkiy
A Structural-Clustering Based Active Learning for Graph Neural Networks. IDA (1) (2024)
Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu, Jiawei Zhao, Yuandong Tian, Zhangyang Wang
From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. CoRR (2024)
Gen Li, Lu Yin, Jie Ji, Wei Niu, Minghai Qin, Bin Ren, Linke Guo, Shiwei Liu, Xiaolong Ma
NeurRev: Train Better Sparse Neural Network Practically via Neuron Revitalization. ICLR (2024)
Lu Yin, Gen Li, Meng Fang, Li Shen, Tianjin Huang, Zhangyang Wang, Vlado Menkovski, Xiaolong Ma, Mykola Pechenizkiy, Shiwei Liu
Dynamic Sparsity Is Channel-Level Sparsity Learner. NeurIPS (2023)
Tianjin Huang, Shiwei Liu, Tianlong Chen, Meng Fang, Li Shen, Vlado Menkovski, Lu Yin, Yulong Pei, Mykola Pechenizkiy
Enhancing Adversarial Training via Reweighting Optimization Trajectory. ECML/PKDD (1) (2023)
Ricky Maulana Fajri, Yulong Pei, Lu Yin, Mykola Pechenizkiy
A Structural-Clustering Based Active Learning for Graph Neural Networks. CoRR (2023)
Lu Yin, Shiwei Liu, Meng Fang, Tianjin Huang, Vlado Menkovski, Mykola Pechenizkiy
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost. AAAI (2023)
Tianjin Huang, Shiwei Liu, Tianlong Chen, Meng Fang, Li Shen, Vlado Menkovski, Lu Yin, Yulong Pei, Mykola Pechenizkiy
Enhancing Adversarial Training via Reweighting Optimization Trajectory. CoRR (2023)
Zahra Atashgahi, Xuhao Zhang, Neil Kichler, Shiwei Liu, Lu Yin, Mykola Pechenizkiy, Raymond N. J. Veldhuis, Decebal Constantin Mocanu
Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks. CoRR (2023)
Lu Yin, Shiwei Liu, Ajay Jaiswal, Souvik Kundu, Zhangyang Wang
Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity. CoRR (2023)
Zahra Atashgahi, Xuhao Zhang, Neil Kichler, Shiwei Liu, Lu Yin, Mykola Pechenizkiy, Raymond N. J. Veldhuis, Decebal Constantin Mocanu
Supervised Feature Selection with Neuron Evolution in Sparse Neural Networks. Trans. Mach. Learn. Res. 2023 (2023)
Lu Yin, You Wu, Zhenyu Zhang, Cheng-Yu Hsieh, Yaqing Wang, Yiling Jia, Mykola Pechenizkiy, Yi Liang, Zhangyang Wang, Shiwei Liu
Outlier Weighed Layerwise Sparsity (OWL): A Missing Secret Sauce for Pruning LLMs to High Sparsity. CoRR (2023)
Tianjin Huang, Lu Yin, Zhenyu Zhang, Li Shen, Meng Fang, Mykola Pechenizkiy, Zhangyang Wang, Shiwei Liu
Are Large Kernels Better Teachers than Transformers for ConvNets? ICML (2023)
Tianjin Huang, Lu Yin, Zhenyu Zhang, Li Shen, Meng Fang, Mykola Pechenizkiy, Zhangyang Wang, Shiwei Liu
Are Large Kernels Better Teachers than Transformers for ConvNets? CoRR (2023)
Boqian Wu, Qiao Xiao, Shiwei Liu, Lu Yin, Mykola Pechenizkiy, Decebal Constantin Mocanu, Maurice van Keulen, Elena Mocanu
E2ENet: Dynamic Sparse Feature Fusion for Accurate and Efficient 3D Medical Image Segmentation. CoRR (2023)
Jiaxu Zhao, Lu Yin, Shiwei Liu, Meng Fang, Mykola Pechenizkiy
REST: Enhancing Group Robustness in DNNs through Reweighted Sparse Training. CoRR (2023)
Jiaxu Zhao, Lu Yin, Shiwei Liu, Meng Fang, Mykola Pechenizkiy
REST: Enhancing Group Robustness in DNNs Through Reweighted Sparse Training. ECML/PKDD (2) (2023)
Lu Yin, Shiwei Liu, Meng Fang, Tianjin Huang, Vlado Menkovski, Mykola Pechenizkiy
Lottery Pools: Winning More by Interpolating Tickets without Increasing Training or Inference Cost. CoRR (2022)
Lu Yin, Vlado Menkovski, Yulong Pei, Mykola Pechenizkiy
Semantic-Based Few-Shot Classification by Psychometric Learning. IDA (2022)
Lu Yin, Vlado Menkovski, Meng Fang, Tianjin Huang, Yulong Pei, Mykola Pechenizkiy
Superposing many tickets into one: A performance booster for sparse neural network training. UAI (2022)
Lu Yin, Vlado Menkovski, Meng Fang, Tianjin Huang, Yulong Pei, Mykola Pechenizkiy, Decebal Constantin Mocanu, Shiwei Liu
Superposing Many Tickets into One: A Performance Booster for Sparse Neural Network Training. CoRR (2022)
Tianjin Huang, Tianlong Chen, Meng Fang, Vlado Menkovski, Jiaxu Zhao, Lu Yin, Yulong Pei, Decebal Constantin Mocanu, Zhangyang Wang, Mykola Pechenizkiy, Shiwei Liu
You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets. LoG (2022)
Tianjin Huang, Tianlong Chen, Meng Fang, Vlado Menkovski, Jiaxu Zhao, Lu Yin, Yulong Pei, Decebal Constantin Mocanu, Zhangyang Wang, Mykola Pechenizkiy, Shiwei Liu
You Can Have Better Graph Neural Networks by Not Training Weights at All: Finding Untrained GNNs Tickets. CoRR (2022)
Shiwei Liu, Tianlong Chen, Xiaohan Chen, Zahra Atashgahi, Lu Yin, Huanyu Kou, Li Shen, Mykola Pechenizkiy, Zhangyang Wang, Decebal Constantin Mocanu
Sparse Training via Boosting Pruning Plasticity with Neuroregeneration. NeurIPS (2021)