Dong Li

Publication Activity (10 Years)

Years Active: 2024-2024
Publications (10 Years): 7

Top Topics

Language Modeling

Linear Complexity

Sequential Data

Spatially Distributed

Top Venues

Publications

Weigao Sun, Zhen Qin, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong
Linear Attention Sequence Parallelism. CoRR (2024)
Xuyang Shen, Dong Li, Ruitao Leng, Zhen Qin, Weigao Sun, Yiran Zhong
Scaling Laws for Linear Complexity Language Models. CoRR (2024)
Zhen Qin, Xuyang Shen, Dong Li, Weigao Sun, Stan Birchfield, Richard I. Hartley, Yiran Zhong
Unlocking the Secrets of Linear Complexity Sequence Model from A Unified Perspective. CoRR (2024)
Zhen Qin, Yuxin Mao, Xuyang Shen, Dong Li, Jing Zhang, Yuchao Dai, Yiran Zhong
You Only Scan Once: Efficient Multi-dimension Sequential Modeling with LightNet. CoRR (2024)
Zhen Qin, Weigao Sun, Dong Li, Xuyang Shen, Weixuan Sun, Yiran Zhong
Various Lengths, Constant Speed: Efficient Language Modeling with Lightning Attention. CoRR (2024)
Weigao Sun, Zhen Qin, Weixuan Sun, Shidi Li, Dong Li, Xuyang Shen, Yu Qiao, Yiran Zhong
CO2: Efficient Distributed Training with Full Communication-Computation Overlap. ICLR (2024)
Zhen Qin, Songlin Yang, Weixuan Sun, Xuyang Shen, Dong Li, Weigao Sun, Yiran Zhong
HGRN2: Gated Linear RNNs with State Expansion. CoRR (2024)