Xiaozhe Ren

Publication Activity (10 Years)

Years Active: 2019-2024
Publications (10 Years): 25

Top Topics

Motion Field Estimation

Efficient Optimization

Multilayer Perceptron

Language Understanding

Top Venues

Publications

Chuanyang Zheng, Yihang Gao, Han Shi, Minbin Huang, Jingyao Li, Jing Xiong, Xiaozhe Ren, Michael K. Ng, Xin Jiang, Zhenguo Li, Yu Li
CAPE: Context-Adaptive Positional Encoding for Length Extrapolation. CoRR (2024)
Junsong Chen, Chongjian Ge, Enze Xie, Yue Wu, Lewei Yao, Xiaozhe Ren, Zhongdao Wang, Ping Luo, Huchuan Lu, Zhenguo Li
PixArt-Σ: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generation. CoRR (2024)
Shaohuai Shi, Xinglin Pan, Qiang Wang, Chengjian Liu, Xiaozhe Ren, Zhongzhe Hu, Yu Yang, Bo Li, Xiaowen Chu
ScheMoE: An Extensible Mixture-of-Experts Distributed Training System with Tasks Scheduling. EuroSys (2024)
Yang Luo, Xiaozhe Ren, Zangwei Zheng, Zhuo Jiang, Xin Jiang, Yang You
CAME: Confidence-guided Adaptive Memory Efficient Optimization. ACL (1) (2023)
Yang Luo, Xiaozhe Ren, Zangwei Zheng, Zhuo Jiang, Xin Jiang, Yang You
CAME: Confidence-guided Adaptive Memory Efficient Optimization. CoRR (2023)
Bufang Yang, Lixing He, Neiwen Ling, Zhenyu Yan, Guoliang Xing, Xian Shuai, Xiaozhe Ren, Xin Jiang
EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edge. CoRR (2023)
Xiaozhe Ren, Pingyi Zhou, Xinfan Meng, Xinjing Huang, Yadao Wang, Weichao Wang, Pengfei Li, Xiaoda Zhang, Alexander Podolskiy, Grigory Arshinov, Andrey Bout, Irina Piontkovskaya, Jiansheng Wei, Xin Jiang, Teng Su, Qun Liu, Jun Yao
PanGu-Σ: Towards Trillion Parameter Language Model with Sparse Heterogeneous Computing. CoRR (2023)
Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue, Yang Luo, Xin Jiang, Yang You
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline. CoRR (2023)
Zangwei Zheng, Xiaozhe Ren, Fuzhao Xue, Yang Luo, Xin Jiang, Yang You
Response Length Perception and Sequence Scheduling: An LLM-Empowered LLM Inference Pipeline. NeurIPS (2023)
Jiankai Sun, Chuanyang Zheng, Enze Xie, Zhengying Liu, Ruihang Chu, Jianing Qiu, Jiaqi Xu, Mingyu Ding, Hongyang Li, Mengzhe Geng, Yue Wu, Wenhai Wang, Junsong Chen, Zhangyue Yin, Xiaozhe Ren, Jie Fu, Junxian He, Wu Yuan, Qi Liu, Xihui Liu, Yu Li, Hao Dong, Yu Cheng, Ming Zhang, Pheng-Ann Heng, Jifeng Dai, Ping Luo, Jingdong Wang, Ji-Rong Wen, Xipeng Qiu, Yike Guo, Hui Xiong, Qun Liu, Zhenguo Li
A Survey of Reasoning with Foundation Models. CoRR (2023)
Fuzhao Xue, Xiaoxin He, Xiaozhe Ren, Yuxuan Lou, Yang You
One Student Knows All Experts Know: From Sparse to Dense. Tiny Papers @ ICLR (2023)
Bufang Yang, Lixing He, Neiwen Ling, Zhenyu Yan, Guoliang Xing, Xian Shuai, Xiaozhe Ren, Xin Jiang
EdgeFM: Leveraging Foundation Model for Open-set Learning on the Edge. SenSys (2023)
Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Yongming Chen, Xin Jiang, Yang You
A Study on Transformer Configuration and Training Objective. ICML (2023)
Jiahui Gao, Hang Xu, Han Shi, Xiaozhe Ren, Philip L. H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li
AutoBERT-Zero: Evolving BERT Backbone from Scratch. AAAI (2022)
Fuzhao Xue, Jianghai Chen, Aixin Sun, Xiaozhe Ren, Zangwei Zheng, Xiaoxin He, Xin Jiang, Yang You
Deeper vs Wider: A Revisit of Transformer Configuration. CoRR (2022)
Fuzhao Xue, Xiaoxin He, Xiaozhe Ren, Yuxuan Lou, Yang You
One Student Knows All Experts Know: From Sparse to Dense. CoRR (2022)
Chenhe Dong, Guangrun Wang, Hang Xu, Jiefeng Peng, Xiaozhe Ren, Xiaodan Liang
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation. CoRR (2021)
Xiaoxin He, Fuzhao Xue, Xiaozhe Ren, Yang You
Large-Scale Deep Learning Optimizations: A Comprehensive Survey. CoRR (2021)
Han Shi, Jiahui Gao, Xiaozhe Ren, Hang Xu, Xiaodan Liang, Zhenguo Li, James T. Kwok
SparseBERT: Rethinking the Importance Analysis in Self-attention. CoRR (2021)
Chenhe Dong, Guangrun Wang, Hang Xu, Jiefeng Peng, Xiaozhe Ren, Xiaodan Liang
EfficientBERT: Progressively Searching Multilayer Perceptron via Warm-up Knowledge Distillation. EMNLP (Findings) (2021)
Jiahui Gao, Hang Xu, Han Shi, Xiaozhe Ren, Philip L. H. Yu, Xiaodan Liang, Xin Jiang, Zhenguo Li
AutoBERT-Zero: Evolving BERT Backbone from Scratch. CoRR (2021)
Han Shi, Jiahui Gao, Xiaozhe Ren, Hang Xu, Xiaodan Liang, Zhenguo Li, James Tin-Yau Kwok
SparseBERT: Rethinking the Importance Analysis in Self-attention. ICML (2021)
Zhihua Jin, Xin Jiang, Xingbo Wang, Qun Liu, Yong Wang, Xiaozhe Ren, Huamin Qu
NumGPT: Improving Numeracy Ability of Generative Pre-trained Models. CoRR (2021)
Wei Zeng, Xiaozhe Ren, Teng Su, Hui Wang, Yi Liao, Zhiwei Wang, Xin Jiang, ZhenZhang Yang, Kaisheng Wang, Xiaoda Zhang, Chen Li, Ziyan Gong, Yifan Yao, Xinjing Huang, Jun Wang, Jianfeng Yu, Qi Guo, Yue Yu, Yan Zhang, Jin Wang, Hengtao Tao, Dasen Yan, Zexuan Yi, Fang Peng, Fangqing Jiang, Han Zhang, Lingfeng Deng, Yehong Zhang, Zhe Lin, Chao Zhang, Shaojie Zhang, Mingyue Guo, Shanzhi Gu, Gaojun Fan, Yaowei Wang, Xuefeng Jin, Qun Liu, Yonghong Tian
PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computation. CoRR (2021)
Junqiu Wei, Xiaozhe Ren, Xiaoguang Li, Wenyong Huang, Yi Liao, Yasheng Wang, Jiashu Lin, Xin Jiang, Xiao Chen, Qun Liu
NEZHA: Neural Contextualized Representation for Chinese Language Understanding. CoRR (2019)