Shengding Hu

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 40

Top Topics

Answering Questions

Comprehensive Evaluation

Top Venues

Publications

Yufei Huang, Shengding Hu, Xu Han, Zhiyuan Liu, Maosong Sun
Unified View of Grokking, Double Descent and Emergent Abilities: A Perspective from Circuits Competition. CoRR (2024)
Chenyang Song, Xu Han, Zhengyan Zhang, Shengding Hu, Xiyu Shi, Kuai Li, Chen Chen, Zhiyuan Liu, Guangli Li, Tao Yang, Maosong Sun
ProSparse: Introducing and Enhancing Intrinsic Activation Sparsity within Large Language Models. CoRR (2024)
Zhili Cheng, Zhitong Wang, Jinyi Hu, Shengding Hu, An Liu, Yuge Tu, Pengkai Li, Lei Shi, Zhiyuan Liu, Maosong Sun
LEGENT: Open Platform for Embodied Agents. CoRR (2024)
Xinrong Zhang, Yingfa Chen, Shengding Hu, Zihang Xu, Junhao Chen, Moo Khai Hao, Xu Han, Zhen Leng Thai, Shuo Wang, Zhiyuan Liu, Maosong Sun
∞Bench: Extending Long Context Evaluation Beyond 100K Tokens. CoRR (2024)
Chaoqun He, Renjie Luo, Shengding Hu, Yuanqian Zhao, Jie Zhou, Hanghao Wu, Jiajie Zhang, Xu Han, Zhiyuan Liu, Maosong Sun
UltraEval: A Lightweight Platform for Flexible and Comprehensive Evaluation for LLMs. CoRR (2024)
Shengding Hu, Yuge Tu, Xu Han, Chaoqun He, Ganqu Cui, Xiang Long, Zhi Zheng, Yewei Fang, Yuxiang Huang, Weilin Zhao, Xinrong Zhang, Zhen Leng Thai, Kai Zhang, Chongyi Wang, Yuan Yao, Chenyang Zhao, Jie Zhou, Jie Cai, Zhongwu Zhai, Ning Ding, Chao Jia, Guoyang Zeng, Dahai Li, Zhiyuan Liu, Maosong Sun
MiniCPM: Unveiling the Potential of Small Language Models with Scalable Training Strategies. CoRR (2024)
Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Leng Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems. ACL (1) (2024)
Xinrong Zhang, Yingfa Chen, Shengding Hu, Xu Han, Zihang Xu, Yuanwei Xu, Weilin Zhao, Maosong Sun, Zhiyuan Liu
Beyond the Turn-Based Game: Enabling Real-Time Conversations with Duplex Models. CoRR (2024)
Chaoqun He, Renjie Luo, Yuzhuo Bai, Shengding Hu, Zhen Leng Thai, Junhao Shen, Jinyi Hu, Xu Han, Yujie Huang, Yuxiang Zhang, Jie Liu, Lei Qi, Zhiyuan Liu, Maosong Sun
OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific Problems. CoRR (2024)
Shengding Hu, Xin Liu, Xu Han, Xinrong Zhang, Chaoqun He, Weilin Zhao, Yankai Lin, Ning Ding, Zebin Ou, Guoyang Zeng, Zhiyuan Liu, Maosong Sun
Predicting Emergent Abilities with Infinite Resolution Evaluation. ICLR (2024)
Junhao Chen, Shengding Hu, Zhiyuan Liu, Maosong Sun
States Hidden in Hidden States: LLMs Emerge Discrete State Representations Implicitly. CoRR (2024)
Shengding Hu, Yifan Luo, Huadong Wang, Xingyi Cheng, Zhiyuan Liu, Maosong Sun
Won't Get Fooled Again: Answering Questions with False Premises. ACL (1) (2023)
Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Zhi Zheng, Shengding Hu, Zhiyuan Liu, Maosong Sun, Bowen Zhou
Enhancing Chat Language Models by Scaling High-quality Instructional Conversations. CoRR (2023)
Yulin Chen, Ning Ding, Xiaobin Wang, Shengding Hu, Haitao Zheng, Zhiyuan Liu, Pengjun Xie
Exploring Lottery Prompts for Pre-trained Language Models. ACL (1) (2023)
Yujia Qin, Shengding Hu, Yankai Lin, Weize Chen, Ning Ding, Ganqu Cui, Zheni Zeng, Yufei Huang, Chaojun Xiao, Chi Han, Yi Ren Fung, Yusheng Su, Huadong Wang, Cheng Qian, Runchu Tian, Kunlun Zhu, Shihao Liang, Xingyu Shen, Bokai Xu, Zhen Zhang, Yining Ye, Bowen Li, Ziwei Tang, Jing Yi, Yuzhang Zhu, Zhenning Dai, Lan Yan, Xin Cong, Yaxi Lu, Weilin Zhao, Yuxiang Huang, Junxi Yan, Xu Han, Xian Sun, Dahai Li, Jason Phang, Cheng Yang, Tongshuang Wu, Heng Ji, Zhiyuan Liu, Maosong Sun
Tool Learning with Foundation Models. CoRR (2023)
Yusheng Su, Chi-Min Chan, Jiali Cheng, Yujia Qin, Yankai Lin, Shengding Hu, Zonghan Yang, Ning Ding, Zhiyuan Liu, Maosong Sun
Arbitrary Few Parameters are Good Enough for Adapting Large-scale Pre-trained Language Models. CoRR (2023)
Shengding Hu, Yifan Luo, Huadong Wang, Xingyi Cheng, Zhiyuan Liu, Maosong Sun
Won't Get Fooled Again: Answering Questions with False Premises. CoRR (2023)
Yusheng Su, Chi-Min Chan, Jiali Cheng, Yujia Qin, Yankai Lin, Shengding Hu, Zonghan Yang, Ning Ding, Xingzhi Sun, Guotong Xie, Zhiyuan Liu, Maosong Sun
Exploring the Impact of Model Scaling on Parameter-Efficient Tuning. EMNLP (2023)
Ning Ding, Yulin Chen, Bokai Xu, Yujia Qin, Shengding Hu, Zhiyuan Liu, Maosong Sun, Bowen Zhou
Enhancing Chat Language Models by Scaling High-quality Instructional Conversations. EMNLP (2023)
Shengding Hu, Ning Ding, Weilin Zhao, Xingtai Lv, Zhen Zhang, Zhiyuan Liu, Maosong Sun
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. ACL (demo) (2023)
Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Parameter-efficient fine-tuning of large-scale pre-trained language models. Nat. Mac. Intell. 5 (3) (2023)
Shengding Hu, Ning Ding, Weilin Zhao, Xingtai Lv, Zhen Zhang, Zhiyuan Liu, Maosong Sun
OpenDelta: A Plug-and-play Library for Parameter-efficient Adaptation of Pre-trained Models. CoRR (2023)
Yulin Chen, Ning Ding, Xiaobin Wang, Shengding Hu, Hai-Tao Zheng, Zhiyuan Liu, Pengjun Xie
Exploring Lottery Prompts for Pre-trained Language Models. CoRR (2023)
Shengding Hu, Xin Liu, Xu Han, Xinrong Zhang, Chaoqun He, Weilin Zhao, Yankai Lin, Ning Ding, Zebin Ou, Guoyang Zeng, Zhiyuan Liu, Maosong Sun
Unlock Predictable Scaling from Emergent Abilities. CoRR (2023)
Zihao Fu, Wai Lam, Qian Yu, Anthony Man-Cho So, Shengding Hu, Zhiyuan Liu, Nigel Collier
Decoder-Only or Encoder-Decoder? Interpreting Language Model as a Regularized Encoder-Decoder. CoRR (2023)
Ganqu Cui, Shengding Hu, Ning Ding, Longtao Huang, Zhiyuan Liu
Prototypical Verbalizer for Prompt-based Few-shot Tuning. ACL (1) (2022)
Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Haitao Zheng, Maosong Sun
OpenPrompt: An Open-source Framework for Prompt-learning. ACL (demo) (2022)
Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Jingang Wang, Juanzi Li, Wei Wu, Maosong Sun
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification. ACL (1) (2022)
Ning Ding, Yujia Qin, Guang Yang, Fuchao Wei, Zonghan Yang, Yusheng Su, Shengding Hu, Yulin Chen, Chi-Min Chan, Weize Chen, Jing Yi, Weilin Zhao, Xiaozhi Wang, Zhiyuan Liu, Hai-Tao Zheng, Jianfei Chen, Yang Liu, Jie Tang, Juanzi Li, Maosong Sun
Delta Tuning: A Comprehensive Study of Parameter Efficient Methods for Pre-trained Language Models. CoRR (2022)
Shengding Hu, Zhen Zhang, Ning Ding, Yadao Wang, Yasheng Wang, Zhiyuan Liu, Maosong Sun
Sparse Structure Search for Delta Tuning. NeurIPS (2022)
Hao Peng, Xiaozhi Wang, Shengding Hu, Hailong Jin, Lei Hou, Juanzi Li, Zhiyuan Liu, Qun Liu
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models. EMNLP (2022)
Ganqu Cui, Shengding Hu, Ning Ding, Longtao Huang, Zhiyuan Liu
Prototypical Verbalizer for Prompt-based Few-shot Tuning. CoRR (2022)
Hao Peng, Xiaozhi Wang, Shengding Hu, Hailong Jin, Lei Hou, Juanzi Li, Zhiyuan Liu, Qun Liu
COPEN: Probing Conceptual Knowledge in Pre-trained Language Models. CoRR (2022)
Shengding Hu, Zhen Zhang, Ning Ding, Yadao Wang, Yasheng Wang, Zhiyuan Liu, Maosong Sun
Sparse Structure Search for Parameter-Efficient Tuning. CoRR (2022)
Shengding Hu, Ning Ding, Huadong Wang, Zhiyuan Liu, Juanzi Li, Maosong Sun
Knowledgeable Prompt-tuning: Incorporating Knowledge into Prompt Verbalizer for Text Classification. CoRR (2021)
Jie Zhou, Shengding Hu, Xin Lv, Cheng Yang, Zhiyuan Liu, Wei Xu, Jie Jiang, Juanzi Li, Maosong Sun
KACC: A Multi-task Benchmark for Knowledge Abstraction, Concretization and Completion. ACL/IJCNLP (Findings) (2021)
Ning Ding, Shengding Hu, Weilin Zhao, Yulin Chen, Zhiyuan Liu, Hai-Tao Zheng, Maosong Sun
OpenPrompt: An Open-source Framework for Prompt-learning. CoRR (2021)
Shengding Hu, Zheng Xiong, Meng Qu, Xingdi Yuan, Marc-Alexandre Côté, Zhiyuan Liu, Jian Tang
Graph Policy Network for Transferable Active Learning on Graphs. NeurIPS (2020)
Jie Zhou, Ganqu Cui, Shengding Hu, Zhengyan Zhang, Cheng Yang, Zhiyuan Liu, Lifeng Wang, Changcheng Li, Maosong Sun
Graph neural networks: A review of methods and applications. AI Open 1 (2020)
Shengding Hu, Zheng Xiong, Meng Qu, Xingdi Yuan, Marc-Alexandre Côté, Zhiyuan Liu, Jian Tang
Graph Policy Network for Transferable Active Learning on Graphs. CoRR (2020)