Hongyu Wang

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 5

Top Topics

Language Models For Information Retrieval

Translation Model

Language Modelling

Top Venues

Publications

Hongyu Wang, Shuming Ma, Ruiping Wang, Furu Wei
Q-Sparse: All Large Language Models can be Fully Sparsely-Activated. CoRR (2024)
Shuming Ma, Hongyu Wang, Lingxiao Ma, Lei Wang, Wenhui Wang, Shaohan Huang, Li Dong, Ruiping Wang, Jilong Xue, Furu Wei
The Era of 1-bit LLMs: All Large Language Models are in 1.58 Bits. CoRR (2024)
Hongyu Wang, Shuming Ma, Shaohan Huang, Li Dong, Wenhui Wang, Zhiliang Peng, Yu Wu, Payal Bajaj, Saksham Singhal, Alon Benhaim, Barun Patra, Zhun Liu, Vishrav Chaudhary, Xia Song, Furu Wei
Magneto: A Foundation Transformer. ICML (2023)
Hongyu Wang, Shuming Ma, Li Dong, Shaohan Huang, Huaijie Wang, Lingxiao Ma, Fan Yang, Ruiping Wang, Yi Wu, Furu Wei
BitNet: Scaling 1-bit Transformers for Large Language Models. CoRR (2023)
Shuming Ma, Hongyu Wang, Shaohan Huang, Wenhui Wang, Zewen Chi, Li Dong, Alon Benhaim, Barun Patra, Vishrav Chaudhary, Xia Song, Furu Wei
TorchScale: Transformers at Scale. CoRR (2022)