Shwai He

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 24

Top Topics

Dynamic Networks

Machine Translation

Top Venues

Publications

Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao, Jianzong Wang, Ning Cheng, Tianyi Zhou
Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning. ACL (1) (2024)
Shwai He, Tianlong Chen
RESSA: Repair Sparse Vision-Language Models via Sparse Cross-Modality Adaptation. CoRR (2024)
Shwai He, Daize Dong, Liang Ding, Ang Li
Demystifying the Compression of Mixture-of-Experts Through a Unified Framework. CoRR (2024)
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning. CoRR (2024)
Run-Ze Fan, Xuefeng Li, Haoyang Zou, Junlong Li, Shwai He, Ethan Chern, Jiewen Hu, Pengfei Liu
Reformatted Alignment. CoRR (2024)
Hongtai Jing, Zhengtao Gao, Sheng Xu, Tao Shen, Zhangzhi Peng, Shwai He, Tao You, Shuang Ye, Wei Lin, Siqi Sun
Accurate prediction of antibody function and structure using bio-inspired antibody language model. Briefings Bioinform. 25 (4) (2024)
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Jiuxiang Gu, Tianyi Zhou
Selective Reflection-Tuning: Student-Selected Data Recycling for LLM Instruction-Tuning. ACL (Findings) (2024)
Ming Li, Yong Zhang, Shwai He, Zhitao Li, Hongyu Zhao, Jianzong Wang, Ning Cheng, Tianyi Zhou
Superfiltering: Weak-to-Strong Data Filtering for Fast Instruction-Tuning. CoRR (2024)
Shwai He, Guoheng Sun, Zheyu Shen, Ang Li
What Matters in Transformers? Not All Attention is Needed. CoRR (2024)
Prajwal Singhania, Siddharth Singh, Shwai He, Soheil Feizi, Abhinav Bhatele
Loki: Low-Rank Keys for Efficient Sparse Attention. CoRR (2024)
Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao
MerA: Merging Pretrained Adapters For Few-Shot Learning. CoRR (2023)
Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts. EMNLP (2023)
Chenbo Jiang, Jie Yang, Shwai He, Yu-Kun Lai, Lin Gao
NeuralSlice: Neural 3D Triangle Mesh Reconstruction via Slicing 4D Tetrahedral Meshes. ICML (2023)
Shwai He, Chenbo Jiang, Daize Dong, Liang Ding
SD-Conv: Towards the Parameter-Efficiency of Dynamic Convolution. WACV (2023)
Ming Li, Lichang Chen, Jiuhai Chen, Shwai He, Heng Huang, Jiuxiang Gu, Tianyi Zhou
Reflection-Tuning: Data Recycling Improves LLM Instruction-Tuning. CoRR (2023)
Shwai He, Run-Ze Fan, Liang Ding, Li Shen, Tianyi Zhou, Dacheng Tao
Merging Experts into One: Improving Computational Efficiency of Mixture of Experts. CoRR (2023)
Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao
PAD-Net: An Efficient Framework for Dynamic Networks. ACL (1) (2023)
Shwai He, Liang Ding, Daize Dong, Boan Liu, Fuqiang Yu, Dacheng Tao
Cherry Hypothesis: Identifying the Cherry on the Cake for Dynamic Networks. CoRR (2022)
Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao
Vega-MT: The JD Explore Academy Translation System for WMT22. CoRR (2022)
Shwai He, Yuhang Li, Chenbo Jiang, Shi Gu
When Sparsity Meets Dynamic Convolution. CoRR (2022)
Shwai He, Liang Ding, Daize Dong, Miao Zhang, Dacheng Tao
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters. CoRR (2022)
Changtong Zan, Keqin Peng, Liang Ding, Baopu Qiu, Boan Liu, Shwai He, Qingyu Lu, Zheng Zhang, Chuang Liu, Weifeng Liu, Yibing Zhan, Dacheng Tao
Vega-MT: The JD Explore Academy Machine Translation System for WMT22. WMT (2022)
Shwai He, Liang Ding, Daize Dong, Jeremy Zhang, Dacheng Tao
SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapters. EMNLP (Findings) (2022)
Shwai He, Shi Gu
Multi-modal Attention Network for Stock Movements Prediction. CoRR (2021)