Furu Wei

ORCID

Publication Activity (10 Years)

Years Active: 2005-2024
Publications (10 Years): 455

Top Venues

Publications

Shujie Hu, Long Zhou, Shujie Liu, Sanyuan Chen, Hongkun Hao, Jing Pan, Xunying Liu, Jinyu Li, Sunit Sivasankaran, Linquan Liu, Furu Wei
WavLLM: Towards Robust and Adaptive Speech Large Language Model. CoRR (2024)
Yuxian Gu, Li Dong, Yaru Hao, Qingxiu Dong, Minlie Huang, Furu Wei
Towards Optimal Learning of Language Models. CoRR (2024)
Bing Han, Long Zhou, Shujie Liu, Sanyuan Chen, Lingwei Meng, Yanming Qian, Yanqing Liu, Sheng Zhao, Jinyu Li, Furu Wei
VALL-E R: Robust and Efficient Zero-Shot Text-to-Speech Synthesis via Monotonic Alignment. CoRR (2024)
Tianyi Tang, Hongyuan Lu, Yuchen Jiang, Haoyang Huang, Dongdong Zhang, Wayne Xin Zhao, Tom Kocmi, Furu Wei
Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References. NAACL-HLT (2024)
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Learning to Rank in Generative Retrieval. AAAI (2024)
Zhengyang Tang, Xingxing Zhang, Benyou Wang, Furu Wei
MathScale: Scaling Instruction Tuning for Mathematical Reasoning. CoRR (2024)
Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Calibrating LLM-Based Evaluator. LREC/COLING (2024)
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Adrian de Wynter, Yan Xia, Wenshan Wu, Ting Song, Man Lan, Furu Wei
LLM as a Mastermind: A Survey of Strategic Reasoning with Large Language Models. CoRR (2024)
Hongyuan Lu, Haoyang Huang, Dongdong Zhang, Furu Wei, Wai Lam
Revamping Multilingual Agreement Bidirectionally via Switched Back-translation for Multilingual Neural Machine Translation. EACL (Findings) (2024)
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. CoRR (2024)
Niklas Muennighoff, Hongjin Su, Liang Wang, Nan Yang, Furu Wei, Tao Yu, Amanpreet Singh, Douwe Kiela
Generative Representational Instruction Tuning. CoRR (2024)
Jiawei Zhou, Li Dong, Furu Wei, Lei Chen
Semi-Parametric Retrieval via Binary Token Index. CoRR (2024)
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
Multilingual E5 Text Embeddings: A Technical Report. CoRR (2024)
Peizhong Gao, Ao Xie, Shaoguang Mao, Wenshan Wu, Yan Xia, Haipeng Mi, Furu Wei
Meta Reasoning for Large Language Models. CoRR (2024)
Zhenhailong Wang, Shaoguang Mao, Wenshan Wu, Tao Ge, Furu Wei, Heng Ji
Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration. NAACL-HLT (2024)
Xin Cheng, Xun Wang, Tao Ge, Si-Qing Chen, Furu Wei, Dongyan Zhao, Rui Yan
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines. ACL (Findings) (2024)
Daixuan Cheng, Shaohan Huang, Furu Wei
Adapting Large Language Models via Reading Comprehension. ICLR (2024)
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
Kosmos-G: Generating Images in Context with Multimodal Large Language Models. ICLR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Mixture of LoRA Experts. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Text Diffusion with Reinforced Conditioning. AAAI (2024)
Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei
VioLA: Conditional Language Models for Speech Recognition, Synthesis, and Translation. IEEE ACM Trans. Audio Speech Lang. Process. 32 (2024)
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
Improving Text Embeddings with Large Language Models. ACL (1) (2024)
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
Improving Domain Adaptation through Extended-Text Reading Comprehension. CoRR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Mixture of LoRA Experts. ICLR (2024)
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
Improving Text Embeddings with Large Language Models. CoRR (2024)
Yadong Zhang, Shaoguang Mao, Tao Ge, Xun Wang, Yan Xia, Man Lan, Furu Wei
K-Level Reasoning with Large Language Models. CoRR (2024)
Liang Zhang, Qin Jin, Haoyang Huang, Dongdong Zhang, Furu Wei
Respond in my Language: Mitigating Language Inconsistency in Response Generation based on Large Language Models. ACL (1) (2024)
Dawei Zhu, Nan Yang, Liang Wang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
PoSE: Efficient Context Window Extension of LLMs via Positional Skip-wise Training. ICLR (2024)
Qiushi Zhu, Long Zhou, Ziqiang Zhang, Shujie Liu, Binxing Jiao, Jie Zhang, Li-Rong Dai, Daxin Jiang, Jinyu Li, Furu Wei
VatLM: Visual-Audio-Text Pre-Training With Unified Masked Prediction for Speech Representation Learning. IEEE Trans. Multim. 26 (2024)
Hongkun Hao, Long Zhou, Shujie Liu, Jinyu Li, Shujie Hu, Rui Wang, Furu Wei
Boosting Large Language Model for Speech Synthesis: An Empirical Study. CoRR (2024)
Lingwei Meng, Long Zhou, Shujie Liu, Sanyuan Chen, Bing Han, Shujie Hu, Yanqing Liu, Jinyu Li, Sheng Zhao, Xixin Wu, Helen Meng, Furu Wei
Autoregressive Speech Synthesis without Vector Quantization. CoRR (2024)
Yadong Zhang, Shaoguang Mao, Wenshan Wu, Yan Xia, Tao Ge, Man Lan, Furu Wei
Enhancing Language Model Rationality with Bi-Directional Deliberation Reasoning. CoRR (2024)
Haoyu Liu, Jianfeng Liu, Shaohan Huang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Furu Wei, Qi Zhang
Se²: Sequential Example Selection for In-Context Learning. ACL (Findings) (2024)
Xun Wu, Shaohan Huang, Wenhui Wang, Furu Wei
Multi-Head Mixture-of-Experts. CoRR (2024)
Wenshan Wu, Shaoguang Mao, Yadong Zhang, Yan Xia, Li Dong, Lei Cui, Furu Wei
Visualization-of-Thought Elicits Spatial Reasoning in Large Language Models. CoRR (2024)
Tao Ge, Jing Hu, Lei Wang, Xun Wang, Si-Qing Chen, Furu Wei
In-context Autoencoder for Context Compression in a Large Language Model. ICLR (2024)
Hangbo Bao, Li Dong, Wenhui Wang, Nan Yang, Songhao Piao, Furu Wei
Fine-tuning pretrained transformer encoders for sequence-to-sequence learning. Int. J. Mach. Learn. Cybern. 15 (5) (2024)
Ziqiang Zhang, Sanyuan Chen, Long Zhou, Yu Wu, Shuo Ren, Shujie Liu, Zhuoyuan Yao, Xun Gong, Li-Rong Dai, Jinyu Li, Furu Wei
SpeechLM: Enhanced Speech Pre-Training With Unpaired Textual Data. IEEE ACM Trans. Audio Speech Lang. Process. 32 (2024)
Sanyuan Chen, Shujie Liu, Long Zhou, Yanqing Liu, Xu Tan, Jinyu Li, Sheng Zhao, Yao Qian, Furu Wei
VALL-E 2: Neural Codec Language Models are Human Parity Zero-Shot Text to Speech Synthesizers. CoRR (2024)
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
ResLoRA: Identity Residual Mapping in Low-Rank Adaption. ACL (Findings) (2024)
Liang Wang, Nan Yang, Furu Wei
Learning to Retrieve In-Context Examples for Large Language Models. EACL (1) (2024)
Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
MiniLLM: Knowledge Distillation of Large Language Models. ICLR (2024)
Zonglin Yang, Li Dong, Xinya Du, Hao Cheng, Erik Cambria, Xiaodong Liu, Jianfeng Gao, Furu Wei
Language Models as Inductive Reasoners. EACL (1) (2024)
Ting Jiang, Shaohan Huang, Shengyue Luo, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang, Deqing Wang, Fuzhen Zhuang
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. CoRR (2024)
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models. CoRR (2024)
Haoyu Liu, Jianfeng Liu, Shaohan Huang, Yuefeng Zhan, Hao Sun, Weiwei Deng, Furu Wei, Qi Zhang
: Sequential Example Selection for In-Context Learning. CoRR (2024)
Daixuan Cheng, Yuxian Gu, Shaohan Huang, Junyu Bi, Minlie Huang, Furu Wei
Instruction Pre-Training: Language Models are Supervised Multitask Learners. CoRR (2024)
Shuhua Shi, Shaohan Huang, Minghui Song, Zhoujun Li, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
ResLoRA: Identity Residual Mapping in Low-Rank Adaption. CoRR (2024)
Tianyi Tang, Wenyang Luo, Haoyang Huang, Dongdong Zhang, Xiaolei Wang, Xin Zhao, Furu Wei, Ji-Rong Wen
Language-Specific Neurons: The Key to Multilingual Capabilities in Large Language Models. ACL (1) (2024)
Dawei Zhu, Liang Wang, Nan Yang, Yifan Song, Wenhao Wu, Furu Wei, Sujian Li
LongEmbed: Extending Embedding Models for Long Context Retrieval. CoRR (2024)
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Qixiang Ye, Furu Wei
Grounding Multimodal Large Language Models to the World. ICLR (2024)
Xin Cheng, Xun Wang, Xingxing Zhang, Tao Ge, Si-Qing Chen, Furu Wei, Huishuai Zhang, Dongyan Zhao
xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token. CoRR (2024)
Haoran Li, Qingxiu Dong, Zhengyang Tang, Chaojun Wang, Xingxing Zhang, Haoyang Huang, Shaohan Huang, Xiaolong Huang, Zeqiang Huang, Dongdong Zhang, Yuxian Gu, Xin Cheng, Xun Wang, Si-Qing Chen, Li Dong, Wei Lu, Zhifang Sui, Benyou Wang, Wai Lam, Furu Wei
Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language Models. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Text Diffusion with Reinforced Conditioning. CoRR (2024)
Yutao Sun, Li Dong, Yi Zhu, Shaohan Huang, Wenhui Wang, Shuming Ma, Quanlu Zhang, Jianyong Wang, Furu Wei
You Only Cache Once: Decoder-Decoder Architectures for Language Models. CoRR (2024)
Yixing Li, Yuxian Gu, Li Dong, Dequan Wang, Yu Cheng, Furu Wei
Direct Preference Knowledge Distillation for Large Language Models. CoRR (2024)
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
Fine-Tuning LLaMA for Multi-Stage Text Retrieval. SIGIR (2024)
Xun Wu, Shaohan Huang, Furu Wei
Multimodal Large Language Model is a Human-Aligned Annotator for Text-to-Image Generation. CoRR (2024)
Yuxuan Liu, Tianchi Yang, Shaohan Huang, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
HD-Eval: Aligning Large Language Model Evaluators Through Hierarchical Criteria Decomposition. ACL (1) (2024)
Xin Cheng, Xun Wang, Tao Ge, Si-Qing Chen, Furu Wei, Dongyan Zhao, Rui Yan
SCALE: Synergized Collaboration of Asymmetric Language Translation Engines. CoRR (2023)
Jinghan Yang, Shuming Ma, Furu Wei
Auto-ICL: In-Context Learning without Human Supervision. CoRR (2023)
Tianyi Tang, Hongyuan Lu, Yuchen Eleanor Jiang, Haoyang Huang, Dongdong Zhang, Wayne Xin Zhao, Furu Wei
Not All Metrics Are Guilty: Improving NLG Evaluation with LLM Paraphrasing. CoRR (2023)
Daixuan Cheng, Shaohan Huang, Junyu Bi, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Furu Wei, Denvy Deng, Qi Zhang
UPRISE: Universal Prompt Retrieval for Improving Zero-Shot Evaluation. CoRR (2023)
Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
Pre-Training to Learn in Context. ACL (1) (2023)
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
Pre-training Language Model as a Multi-perspective Course Learner. ACL (Findings) (2023)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Magneto: A Foundation Transformer. ICML (2023)
Zhiliang Peng, Wenhui Wang, Li Dong, Yaru Hao, Shaohan Huang, Shuming Ma, Furu Wei
Kosmos-2: Grounding Multimodal Large Language Models to the World. CoRR (2023)
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
BitNet: Scaling 1-bit Transformers for Large Language Models. CoRR (2023)
Jian Yang, Shuming Ma, Li Dong, Shaohan Huang, Haoyang Huang, Yuwei Yin, Dongdong Zhang, Liqun Yang, Furu Wei, Zhoujun Li
GanLM: Encoder-Decoder Pre-training with an Auxiliary Discriminator. ACL (1) (2023)
Zhiliang Peng, Li Dong, Hangbo Bao, Furu Wei, Qixiang Ye
A Unified View of Masked Image Modeling. Trans. Mach. Learn. Res. 2023 (2023)
Zhaoyang Wang, Shaohan Huang, Yuxuan Liu, Jiahai Wang, Minghui Song, Zihan Zhang, Haizhen Huang, Furu Wei, Weiwei Deng, Feng Sun, Qi Zhang
Democratizing Reasoning Ability: Tailored Learning from Large Language Model. EMNLP (2023)
Damai Dai, Yutao Sun, Li Dong, Yaru Hao, Shuming Ma, Zhifang Sui, Furu Wei
Why Can GPT Learn In-Context? Language Models Secretly Perform Gradient Descent as Meta-Optimizers. ACL (Findings) (2023)
Xichen Pan, Li Dong, Shaohan Huang, Zhiliang Peng, Wenhu Chen, Furu Wei
Kosmos-G: Generating Images in Context with Multimodal Large Language Models. CoRR (2023)
Tianrui Wang, Long Zhou, Ziqiang Zhang, Yu Wu, Shujie Liu, Yashesh Gaur, Zhuo Chen, Jinyu Li, Furu Wei
VioLA: Unified Codec Language Models for Speech Recognition, Synthesis, and Translation. CoRR (2023)
Beiduo Chen, Shaohan Huang, Zihan Zhang, Wu Guo, Zhenhua Ling, Haizhen Huang, Furu Wei, Weiwei Deng, Qi Zhang
Pre-training Language Model as a Multi-perspective Course Learner. CoRR (2023)
Yuxin Fang, Li Dong, Hangbo Bao, Xinggang Wang, Furu Wei
Corrupted Image Modeling for Self-Supervised Visual Pre-Training. ICLR (2023)
Liang Wang, Nan Yang, Xiaolong Huang, Binxing Jiao, Linjun Yang, Daxin Jiang, Rangan Majumder, Furu Wei
SimLM: Pre-training with Representation Bottleneck for Dense Passage Retrieval. ACL (1) (2023)
Haoyang Huang, Tianyi Tang, Dongdong Zhang, Wayne Xin Zhao, Ting Song, Yan Xia, Furu Wei
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting. CoRR (2023)
Yuxian Gu, Li Dong, Furu Wei, Minlie Huang
Pre-Training to Learn in Context. CoRR (2023)
Nan Yang, Tao Ge, Liang Wang, Binxing Jiao, Daxin Jiang, Linjun Yang, Rangan Majumder, Furu Wei
Inference with Reference: Lossless Acceleration of Large Language Models. CoRR (2023)
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Augmenting Language Models with Long-Term Memory. NeurIPS (2023)
Haoyang Huang, Tianyi Tang, Dongdong Zhang, Xin Zhao, Ting Song, Yan Xia, Furu Wei
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting. EMNLP (Findings) (2023)
Lan Jiang, Haoyang Huang, Dongdong Zhang, Rui Jiang, Furu Wei
One-stop Training of Multiple Capacity Models for Multilingual Machine Translation. CoRR (2023)
Weizhi Wang, Li Dong, Hao Cheng, Xiaodong Liu, Xifeng Yan, Jianfeng Gao, Furu Wei
Augmenting Language Models with Long-Term Memory. CoRR (2023)
Shaoguang Mao, Yuzhe Cai, Yan Xia, Wenshan Wu, Xun Wang, Fengyi Wang, Tao Ge, Furu Wei
ALYMPICS: Language Agents Meet Game Theory. CoRR (2023)
Minghao Li, Tengchao Lv, Jingye Chen, Lei Cui, Yijuan Lu, Dinei A. F. Florêncio, Cha Zhang, Zhoujun Li, Furu Wei
TrOCR: Transformer-Based Optical Character Recognition with Pre-trained Models. AAAI (2023)
Qingxiu Dong, Li Dong, Ke Xu, Guangyan Zhou, Yaru Hao, Zhifang Sui, Furu Wei
Large Language Model for Science: A Study on P vs. NP. CoRR (2023)
Daixuan Cheng, Shaohan Huang, Furu Wei
Adapting Large Language Models via Reading Comprehension. CoRR (2023)
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
TextDiffuser: Diffusion Models as Text Painters. NeurIPS (2023)
Jingye Chen, Yupan Huang, Tengchao Lv, Lei Cui, Qifeng Chen, Furu Wei
TextDiffuser-2: Unleashing the Power of Language Models for Text Rendering. CoRR (2023)
Hongyuan Lu, Haoyang Huang, Shuming Ma, Dongdong Zhang, Wai Lam, Zhaochuan Gao, Anthony Aue, Arul Menezes, Furu Wei
TRIP: Accelerating Document-level Multilingual Pre-training via Triangular Document-level Pre-training on Parallel Data Triplets. EMNLP (Findings) (2023)
Liang Wang, Nan Yang, Furu Wei
Learning to Retrieve In-Context Examples for Large Language Models. CoRR (2023)
Liang Wang, Nan Yang, Xiaolong Huang, Linjun Yang, Rangan Majumder, Furu Wei
Large Search Model: Redefining Search Stack in the Era of LLMs. SIGIR Forum 57 (2) (2023)
Tao Ge, Hu Jing, Li Dong, Shaoguang Mao, Yan Xia, Xun Wang, Si-Qing Chen, Furu Wei
Extensible Prompts for Language Models on Zero-shot Language Style Customization. NeurIPS (2023)
Jiayu Ding, Shuming Ma, Li Dong, Xingxing Zhang, Shaohan Huang, Wenhui Wang, Nanning Zheng, Furu Wei
LongNet: Scaling Transformers to 1, 000, 000, 000 Tokens. CoRR (2023)
Sanyuan Chen, Yu Wu, Chengyi Wang, Shujie Liu, Daniel Tompkins, Zhuo Chen, Wanxiang Che, Xiangzhan Yu, Furu Wei
BEATs: Audio Pre-Training with Acoustic Tokenizers. ICML (2023)
Yongqi Li, Nan Yang, Liang Wang, Furu Wei, Wenjie Li
Generative retrieval for conversational question answering. Inf. Process. Manag. 60 (5) (2023)
Xueguang Ma, Liang Wang, Nan Yang, Furu Wei, Jimmy Lin
Fine-Tuning LLaMA for Multi-Stage Text Retrieval. CoRR (2023)

Furu Wei.css-eqlu8i{font-size:small;padding-left:4px;}

Publication Activity (10 Years)

Top Topics

Top Venues

Furu Wei