Nolan Dey

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 5

Top Topics

Language Model For Information Retrieval

Parameter Values

Degrees Of Freedom

Top Venues

IEEE Robotics Autom. Lett.

Publications

Nolan Dey, Shane Bergsma, Joel Hestness
Sparse maximal update parameterization: A holistic approach to sparse training dynamics. CoRR (2024)
Nolan Dey, Daria Soboleva, Faisal Al-Khateeb, Bowen Yang, Ribhu Pathria, Hemant Khachane, Shaheer Muhammad, Zhiming Chen, Robert Myers, Jacob Robert Steeves, Natalia Vassilieva, Marvin Tom, Joel Hestness
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model. CoRR (2023)
Nolan Dey, Gurpreet Gosal, Zhiming Chen, Hemant Khachane, William Marshall, Ribhu Pathria, Marvin Tom, Joel Hestness
Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster. CoRR (2023)
Faisal Al-Khateeb, Nolan Dey, Daria Soboleva, Joel Hestness
Position Interpolation Improves ALiBi Extrapolation. CoRR (2023)
Victor Reyes Osorio, Rajan Iyengar, Xueyang Yao, Presish Bhattachan, Adrian Ragobar, Nolan Dey, Bryan P. Tripp
37, 000 Human-Planned Robotic Grasps With Six Degrees of Freedom. IEEE Robotics Autom. Lett. 5 (2) (2020)