Shitao Xiao

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 45

Top Topics

Vector Quantization

Top Venues

Publications

Peitian Zhang, Ninglu Shao, Zheng Liu, Shitao Xiao, Hongjin Qian, Qiwei Ye, Zhicheng Dou
Extending Llama-3's Context Ten-Fold Overnight. CoRR (2024)
Peitian Zhang, Zheng Liu, Shitao Xiao, Ninglu Shao, Qiwei Ye, Zhicheng Dou
Soaring from 4K to 400K: Extending LLM's Context with Activation Beacon. CoRR (2024)
Xingrun Xing, Zheng Zhang, Ziyi Ni, Shitao Xiao, Yiming Ju, Siqi Fan, Yequan Wang, Jiajun Zhang, Guoqi Li
SpikeLM: Towards General Spike-Driven Language Modeling via Elastic Bi-Spiking Mechanisms. CoRR (2024)
Peitian Zhang, Zheng Liu, Shitao Xiao, Ninglu Shao, Qiwei Ye, Zhicheng Dou
Compressing Lengthy Context With UltraGist. CoRR (2024)
Junjie Zhou, Yan Shu, Bo Zhao, Boya Wu, Shitao Xiao, Xi Yang, Yongping Xiong, Bo Zhang, Tiejun Huang, Zheng Liu
MLVU: A Comprehensive Benchmark for Multi-Task Long Video Understanding. CoRR (2024)
Ninglu Shao, Shitao Xiao, Zheng Liu, Peitian Zhang
Extensible Embedding: A Flexible Multipler For LLM's Context Length. CoRR (2024)
Kun Luo, Zheng Liu, Shitao Xiao, Tong Zhou, Yubo Chen, Jun Zhao, Kang Liu
Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models. ACL (1) (2024)
Jianlv Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, Zheng Liu
BGE M3-Embedding: Multi-Lingual, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation. CoRR (2024)
Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighoff, Defu Lian, Jian-Yun Nie
C-Pack: Packed Resources For General Chinese Embeddings. SIGIR (2024)
Ninglu Shao, Shitao Xiao, Zheng Liu, Peitian Zhang
Flexibly Scaling Large Language Models Contexts Through Extensible Tokenization. CoRR (2024)
Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval. ACL (1) (2024)
Junjie Zhou, Zheng Liu, Shitao Xiao, Bo Zhao, Yongping Xiong
VISTA: Visualized Text Embedding For Universal Multi-Modal Retrieval. CoRR (2024)
Kun Luo, Zheng Liu, Shitao Xiao, Kang Liu
BGE Landmark Embedding: A Chunking-Free Embedding Method For Retrieval Augmented Long-Context Large Language Models. CoRR (2024)
Xingrun Xing, Boyan Gao, Zheng Zhang, David A. Clifton, Shitao Xiao, Li Du, Guoqi Li, Jiajun Zhang
SpikeLLM: Scaling up Spiking Neural Network to Large Language Models via Saliency-based Spiking. CoRR (2024)
Peitian Zhang, Zheng Liu, Shitao Xiao, Zhicheng Dou, Jian-Yun Nie
A Multi-Task Embedder For Retrieval Augmented LLMs. ACL (1) (2024)
Jianlyu Chen, Shitao Xiao, Peitian Zhang, Kun Luo, Defu Lian, Zheng Liu
M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillation. ACL (Findings) (2024)
Shitao Xiao, Zheng Liu, Peitian Zhang, Xingrun Xing
LM-Cocktail: Resilient Tuning of Language Models via Model Merging. ACL (Findings) (2024)
Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao, Defu Lian
Llama2Vec: Unsupervised Adaptation of Large Language Models for Dense Retrieval. ACL (1) (2024)
Shitao Xiao, Zheng Liu, Peitian Zhang, Xingrun Xing
LM-Cocktail: Resilient Tuning of Language Models via Model Merging. CoRR (2023)
Peitian Zhang, Zheng Liu, Shitao Xiao, Zhicheng Dou, Jing Yao
Hybrid Inverted Index Is a Robust Accelerator for Dense Retrieval. EMNLP (2023)
Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao
Making Large Language Models A Better Foundation For Dense Retrieval. CoRR (2023)
Zihong Wang, Yingxia Shao, Jiyuan He, Jinbao Liu, Shitao Xiao, Tao Feng, Ming Liu
Diversity-aware Deep Ranking Network for Recommendation. CIKM (2023)
Shitao Xiao, Zheng Liu, Peitian Zhang, Niklas Muennighof
C-Pack: Packaged Resources To Advance General Chinese Embedding. CoRR (2023)
Peitian Zhang, Shitao Xiao, Zheng Liu, Zhicheng Dou, Jian-Yun Nie
Retrieve Anything To Augment Large Language Models. CoRR (2023)
Zheng Liu, Shitao Xiao, Yingxia Shao, Zhao Cao
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models. ACL (1) (2023)
Chaofan Li, Zheng Liu, Shitao Xiao, Yingxia Shao, Defu Lian, Zhao Cao
LibVQ: A Toolkit for Optimizing Vector Quantization and Efficient Neural Retrieval. SIGIR (2023)
Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao
RetroMAE-2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models. CoRR (2023)
Shitao Xiao, Yingxia Shao, Yawen Li, Hongzhi Yin, Yanyan Shen, Bin Cui
LECF: recommendation via learnable edge collaborative filtering. Sci. China Inf. Sci. 65 (1) (2022)
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Yingxia Shao, Defu Lian, Chaozhuo Li, Hao Sun, Denvy Deng, Liangjie Zhang, Qi Zhang, Xing Xie
Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval. WWW (2022)
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Denvy Deng, Qi Zhang, Xing Xie
Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings. CoRR (2022)
Shitao Xiao, Zheng Liu, Yingxia Shao, Zhao Cao
RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder. EMNLP (2022)
Shitao Xiao, Zheng Liu
RetroMAE v2: Duplex Masked Auto-Encoder For Pre-Training Retrieval-Oriented Language Models. CoRR (2022)
Xufang Luo, Zheng Liu, Shitao Xiao, Xing Xie, Dongsheng Li
MINDSim: User Simulator for News Recommenders. WWW (2022)
Jianjin Zhang, Zheng Liu, Weihao Han, Shitao Xiao, Ruicheng Zheng, Yingxia Shao, Hao Sun, Hanqing Zhu, Premkumar Srinivasan, Denvy Deng, Qi Zhang, Xing Xie
Uni-Retriever: Towards Learning The Unified Embedding Based Retriever in Bing Sponsored Search. CoRR (2022)
Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Bhuvan Middha, Fangzhao Wu, Xing Xie
Training Large-Scale News Recommenders with Pretrained Language Models in the Loop. KDD (2022)
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Chaozhuo Li, Yingxia Shao, Defu Lian, Xing Xie, Hao Sun, Denvy Deng, Liangjie Zhang, Qi Zhang
Progressively Optimized Bi-Granular Document Representation for Scalable Embedding Based Retrieval. CoRR (2022)
Shitao Xiao, Zheng Liu, Weihao Han, Jianjin Zhang, Defu Lian, Yeyun Gong, Qi Chen, Fan Yang, Hao Sun, Yingxia Shao, Xing Xie
Distill-VQ: Learning Retrieval Oriented Vector Quantization By Distilling Knowledge from Dense Embeddings. SIGIR (2022)
Wei Ou, Shitao Xiao, Chengyu Zhu, Wenbao Han, Qionglu Zhang
An overview of brain-like computing: Architecture, applications, and future trends. Frontiers Neurorobotics 16 (2022)
Jianjin Zhang, Zheng Liu, Weihao Han, Shitao Xiao, Ruicheng Zheng, Yingxia Shao, Hao Sun, Hanqing Zhu, Premkumar Srinivasan, Weiwei Deng, Qi Zhang, Xing Xie
Uni-Retriever: Towards Learning the Unified Embedding Based Retriever in Bing Sponsored Search. KDD (2022)
Junhan Yang, Zheng Liu, Shitao Xiao, Jianxun Lian, Lijun Wu, Defu Lian, Guangzhong Sun, Xing Xie
A Mutually Reinforced Framework for Pretrained Sentence Embeddings. CoRR (2022)
Shitao Xiao, Zheng Liu, Yingxia Shao, Defu Lian, Xing Xie
Search-oriented Differentiable Product Quantization. CoRR (2021)
Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Defu Lian, Sanjay Agrawal, Amit Singh, Guangzhong Sun, Xing Xie
GraphFormers: GNN-nested Transformers for Representation Learning on Textual Graph. NeurIPS (2021)
Junhan Yang, Zheng Liu, Shitao Xiao, Chaozhuo Li, Guangzhong Sun, Xing Xie
GraphFormers: GNN-nested Language Models for Linked Text Representation. CoRR (2021)
Shitao Xiao, Zheng Liu, Yingxia Shao, Defu Lian, Xing Xie
Matching-oriented Embedding Quantization For Ad-hoc Retrieval. EMNLP (1) (2021)
Shitao Xiao, Zheng Liu, Yingxia Shao, Tao Di, Xing Xie
Training Microsoft News Recommenders with Pretrained Language Models in the Loop. CoRR (2021)