Shanda Li

Publication Activity (10 Years)

Years Active: 2021-2024
Publications (10 Years): 14

Top Topics

Relative Position

Fourier Transform

Training Algorithm

Feed Forward Neural Networks

Top Venues

Eng. Appl. Artif. Intell.

Publications

Peichao Cong, Hao Feng, Shanda Li, Tianheng Li, Yutao Xu, Xin Zhang
A visual detection algorithm for autonomous driving road environment perception. Eng. Appl. Artif. Intell. 133 (2024)
Krzysztof Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. AISTATS (2024)
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontañón, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli
Functional Interpolation for Relative Positions improves Long Context Transformers. ICLR (2024)
Shanda Li, Chong You, Guru Guruganesh, Joshua Ainslie, Santiago Ontañón, Manzil Zaheer, Sumit Sanghai, Yiming Yang, Sanjiv Kumar, Srinadh Bhojanapalli
Functional Interpolation for Relative Positions Improves Long Context Transformers. CoRR (2023)
Di He, Shanda Li, Wenlei Shi, Xiaotian Gao, Jia Zhang, Jiang Bian, Liwei Wang, Tie-Yan Liu
Learning Physics-Informed Neural Networks without Stacked Back-propagation. AISTATS (2023)
Krzysztof Marcin Choromanski, Shanda Li, Valerii Likhosherstov, Kumar Avinava Dubey, Shengjie Luo, Di He, Yiming Yang, Tamás Sarlós, Thomas Weingarten, Adrian Weller
Learning a Fourier Transform for Linear Relative Positional Encodings in Transformers. CoRR (2023)
Chuwei Wang, Shanda Li, Di He, Liwei Wang
Is $L^2$ Physics Informed Loss Always Suitable for Training Physics Informed Neural Network? NeurIPS (2022)
Shengjie Luo, Shanda Li, Shuxin Zheng, Tie-Yan Liu, Liwei Wang, Di He
Your Transformer May Not be as Powerful as You Expect. NeurIPS (2022)
Shengjie Luo, Shanda Li, Shuxin Zheng, Tie-Yan Liu, Liwei Wang, Di He
Your Transformer May Not be as Powerful as You Expect. CoRR (2022)
Di He, Wenlei Shi, Shanda Li, Xiaotian Gao, Jia Zhang, Jiang Bian, Liwei Wang, Tie-Yan Liu
Learning Physics-Informed Neural Networks without Stacked Back-propagation. CoRR (2022)
Chuwei Wang, Shanda Li, Di He, Liwei Wang
Physics-Informed Loss Always Suitable for Training Physics-Informed Neural Network? CoRR (2022)
Shanda Li, Xiangning Chen, Di He, Cho-Jui Hsieh
Can Vision Transformers Perform Convolution? CoRR (2021)
Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding. NeurIPS (2021)
Shengjie Luo, Shanda Li, Tianle Cai, Di He, Dinglan Peng, Shuxin Zheng, Guolin Ke, Liwei Wang, Tie-Yan Liu
Stable, Fast and Accurate: Kernelized Attention with Relative Positional Encoding. CoRR (2021)