Rui-Jie Zhu

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 22

Top Topics

Biologically Inspired

Language Modeling

Semantic Relevance

Recent Advances

Top Venues

Tiny Papers @ ICLR

J. Informetrics

Publications

Xuerui Qiu, Rui-Jie Zhu, Yuhong Chou, Zhaorui Wang, Liang-Jian Deng, Guoqi Li
Gated Attention Coding for Training High-Performance and Efficient Spiking Neural Networks. AAAI (2024)
Rui-Jie Zhu, Ziqing Wang, Leilani Gilpin, Jason K. Eshraghian
Autonomous Driving with Spiking Neural Networks. CoRR (2024)
Souvik Kundu, Rui-Jie Zhu, Akhilesh Jaiswal, Peter A. Beerel
Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural Networks: from Algorithms to Technology. ICASSP (2024)
Rui-Jie Zhu, Qihang Zhao, Guoqi Li, Jason Eshraghian
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks. Trans. Mach. Learn. Res. 2024 (2024)
Haoyu Deng, Rui-Jie Zhu, Xuerui Qiu, Yule Duan, Malu Zhang, Liang-Jian Deng
Tensor decomposition based attention module for spiking neural networks. Knowl. Based Syst. 295 (2024)
Yimeng Shan, Malu Zhang, Rui-Jie Zhu, Xuerui Qiu, Jason K. Eshraghian, Haicheng Qu
Advancing Spiking Neural Networks towards Multiscale Spatiotemporal Interaction Learning. CoRR (2024)
Xuerui Qiu, Zheng Luan, Zhaorui Wang, Rui-Jie Zhu
When Spiking neural networks meet temporal attention image decoding and adaptive spiking neuron. CoRR (2024)
Rui-Jie Zhu, Yu Zhang, Ethan Sifferman, Tyler Sheaves, Yiqiao Wang, Dustin Richmond, Peng Zhou, Jason K. Eshraghian
Scalable MatMul-free Language Modeling. CoRR (2024)
Bo Peng, Daniel Goldstein, Quentin Anthony, Alon Albalak, Eric Alcaide, Stella Biderman, Eugene Cheah, Xingjian Du, Teddy Ferdinan, Haowen Hou, Przemyslaw Kazienko, Kranthi Kiran GV, Jan Kocon, Bartlomiej Koptyra, Satyapriya Krishna, Ronald McClelland Jr., Niklas Muennighoff, Fares Obeid, Atsushi Saito, Guangyu Song, Haoqin Tu, Stanislaw Wozniak, Ruichong Zhang, Bingchen Zhao, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence. CoRR (2024)
Qihang Zhao, Rui-Jie Zhu, Liu Yang, Yongming He, Bo Zhou, Luo Cheng
Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System. CoRR (2023)
Xuerui Qiu, Rui-Jie Zhu, Yuhong Chou, Zhaorui Wang, Liang-Jian Deng, Guoqi Li
Gated Attention Coding for Training High-performance and Efficient Spiking Neural Networks. CoRR (2023)
Yimeng Shan, Xuerui Qiu, Rui-Jie Zhu, Ruike Li, Meng Wang, Haicheng Qu
OR Residual Connection Achieving Comparable Accuracy to ADD Residual Connection in Deep Residual Spiking Neural Networks. CoRR (2023)
Souvik Kundu, Rui-Jie Zhu, Akhilesh Jaiswal, Peter A. Beerel
Recent Advances in Scalable Energy-Efficient and Trustworthy Spiking Neural networks: from Algorithms to Technology. CoRR (2023)
Xiaodong Feng, Qihang Zhao, Rui-Jie Zhu
Towards popularity prediction of information cascades via degree distribution and deep neural networks. J. Informetrics 17 (3) (2023)
Zhenyang Zhu, Rui-Jie Zhu, Yunrui Ge, Qihang Zhao
Uni-Match: A Semantic Unified Model for Query-Product Retrieval. Tiny Papers @ ICLR (2023)
Xuerui Qiu, Zheng Luan, Zhaorui Wang, Rui-Jie Zhu
When Spiking Neural Networks Meet Temporal Attention Image Decoding and Adaptive Spiking Neuron. Tiny Papers @ ICLR (2023)
Haoyu Deng, Rui-Jie Zhu, Xuerui Qiu, Yule Duan, Malu Zhang, Liang-Jian Deng
Tensor Decomposition Based Attention Module for Spiking Neural Networks. CoRR (2023)
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Huanqi Cao, Xin Cheng, Michael Chung, Matteo Grella, Kranthi Kiran G. V., Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Xiangru Tang, Bolun Wang, Johan S. Wind, Stanislaw Wozniak, Ruichong Zhang, Zhenyuan Zhang, Qihang Zhao, Peng Zhou, Jian Zhu, Rui-Jie Zhu
RWKV: Reinventing RNNs for the Transformer Era. CoRR (2023)
Bo Peng, Eric Alcaide, Quentin Anthony, Alon Albalak, Samuel Arcadinho, Stella Biderman, Huanqi Cao, Xin Cheng, Michael Chung, Leon Derczynski, Xingjian Du, Matteo Grella, Kranthi Gv, Xuzheng He, Haowen Hou, Przemyslaw Kazienko, Jan Kocon, Jiaming Kong, Bartlomiej Koptyra, Hayden Lau, Jiaju Lin, Krishna Sri Ipsit Mantri, Ferdinand Mom, Atsushi Saito, Guangyu Song, Xiangru Tang, Johan S. Wind, Stanislaw Wozniak, Zhenyuan Zhang, Qinghua Zhou, Jian Zhu, Rui-Jie Zhu
RWKV: Reinventing RNNs for the Transformer Era. EMNLP (Findings) (2023)
Rui-Jie Zhu, Qihang Zhao, Jason K. Eshraghian
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks. CoRR (2023)
Cheng Jin, Rui-Jie Zhu, Xiao Wu, Liang-Jian Deng
SIT: A Bionic and Non-Linear Neuron for Spiking Neural Network. CoRR (2022)
Rui-Jie Zhu, Qihang Zhao, Tianjing Zhang, Haoyu Deng, Yule Duan, Malu Zhang, Liang-Jian Deng
TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks. CoRR (2022)