Joel Hestness

Publication Activity (10 Years)

Years Active: 2009-2024
Publications (10 Years): 25

Top Topics

Keyword Spotting

Brain Tumor Segmentation

Heterogeneous Computing

Computational Challenges

Top Venues

Publications

Nolan Dey, Shane Bergsma, Joel Hestness
Sparse maximal update parameterization: A holistic approach to sparse training dynamics. CoRR (2024)
Gurpreet Gosal, Yishi Xu, Gokul Ramakrishnan, Rituraj Joshi, Avraham Sheinin, Zhiming Chen, Biswajit Mishra, Natalia Vassilieva, Joel Hestness, Neha Sengupta, Sunil Kumar Sahu, Bokang Jia, Onkar Pandit, Satheesh Katipomu, Samta Kamboj, Samujjwal Ghosh, Rahul Pal, Parvez Mullah, Soundar Doraiswamy, Mohamed El Karim Chami, Preslav Nakov
Bilingual Adaptation of Monolingual Foundation Models. CoRR (2024)
Vithursan Thangarasa, Mahmoud Salem, Shreyas Saxena, Chen-Yu Leong, Joel Hestness, Sean Lie
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models. ACL (Findings) (2024)
Vithursan Thangarasa, Mahmoud Salem, Shreyas Saxena, Kevin Leong, Joel Hestness, Sean Lie
MediSwift: Efficient Sparse Pre-trained Biomedical Language Models. CoRR (2024)
Nolan Dey, Daria Soboleva, Faisal Al-Khateeb, Bowen Yang, Ribhu Pathria, Hemant Khachane, Shaheer Muhammad, Zhiming Chen, Robert Myers, Jacob Robert Steeves, Natalia Vassilieva, Marvin Tom, Joel Hestness
BTLM-3B-8K: 7B Parameter Performance in a 3B Parameter Model. CoRR (2023)
Zhiqiang Shen, Tianhua Tao, Liqun Ma, Willie Neiswanger, Zhengzhong Liu, Hongyi Wang, Bowen Tan, Joel Hestness, Natalia Vassilieva, Daria Soboleva, Eric P. Xing
SlimPajama-DC: Understanding Data Combinations for LLM Training. CoRR (2023)
Nolan Dey, Gurpreet Gosal, Zhiming Chen, Hemant Khachane, William Marshall, Ribhu Pathria, Marvin Tom, Joel Hestness
Cerebras-GPT: Open Compute-Optimal Language Models Trained on the Cerebras Wafer-Scale Cluster. CoRR (2023)
Vitaliy Chiley, Vithursan Thangarasa, Abhay Gupta, Anshul Samar, Joel Hestness, Dennis DeCoste
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network. MLSys (2023)
Faisal Al-Khateeb, Nolan Dey, Daria Soboleva, Joel Hestness
Position Interpolation Improves ALiBi Extrapolation. CoRR (2023)
Yuanpeng Li, Joel Hestness, Mohamed Elhoseiny, Liang Zhao, Kenneth Church
Efficiently Disentangle Causal Representations. CoRR (2022)
Ehsan Valavi, Joel Hestness, Newsha Ardalani, Marco Iansiti
Time and the Value of Data. CoRR (2022)
Vitaliy Chiley, Vithursan Thangarasa, Abhay Gupta, Anshul Samar, Joel Hestness, Dennis DeCoste
RevBiFPN: The Fully Reversible Bidirectional Feature Pyramid Network. CoRR (2022)
Ehsan Valavi, Joel Hestness, Marco Iansiti, Newsha Ardalani, Feng Zhu, Karim R. Lakhani
Time Dependency, Data Flow, and Competitive Advantage. CoRR (2022)
Mihir Pendse, Vithursan Thangarasa, Vitaliy Chiley, Ryan Holmdahl, Joel Hestness, Dennis DeCoste
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation. CoRR (2021)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. MLSys (2021)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. CoRR (2020)
Mihir Pendse, Vithursan Thangarasa, Vitaliy Chiley, Ryan Holmdahl, Joel Hestness, Dennis DeCoste
Memory Efficient 3D U-Net with Reversible Mobile Inverted Bottlenecks for Brain Tumor Segmentation. BrainLes@MICCAI (2) (2020)
Joel Hestness, Newsha Ardalani, Gregory F. Diamos
Beyond human-level accuracy: computational challenges in deep learning. PPoPP (2019)
Yuanpeng Li, Liang Zhao, Jianyu Wang, Joel Hestness
Compositional Generalization for Primitive Substitutions. EMNLP/IJCNLP (1) (2019)
Kenneth Ward Church, Joel Hestness
A survey of 25 years of evaluation. Nat. Lang. Eng. 25 (6) (2019)
Joel Hestness, Newsha Ardalani, Greg Diamos
Beyond Human-Level Accuracy: Computational Challenges in Deep Learning. CoRR (2019)
Yuanpeng Li, Liang Zhao, Jianyu Wang, Joel Hestness
Compositional Generalization for Primitive Substitutions. CoRR (2019)
Sercan Ömer Arik, Markus Kliegl, Rewon Child, Joel Hestness, Andrew Gibiansky, Christopher Fougner, Ryan Prenger, Adam Coates
Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting. CoRR (2017)
Joel Hestness, Sharan Narang, Newsha Ardalani, Gregory F. Diamos, Heewoo Jun, Hassan Kianinejad, Md. Mostofa Ali Patwary, Yang Yang, Yanqi Zhou
Deep Learning Scaling is Predictable, Empirically. CoRR (2017)
Sercan Ömer Arik, Markus Kliegl, Rewon Child, Joel Hestness, Andrew Gibiansky, Christopher Fougner, Ryan Prenger, Adam Coates
Convolutional Recurrent Neural Networks for Small-Footprint Keyword Spotting. INTERSPEECH (2017)
Joel Hestness, Stephen W. Keckler, David A. Wood
GPU Computing Pipeline Inefficiencies and Optimization Opportunities in Heterogeneous CPU-GPU Processors. IISWC (2015)
Jason Power, Joel Hestness, Marc S. Orr, Mark D. Hill, David A. Wood
gem5-gpu: A Heterogeneous CPU-GPU Simulator. IEEE Comput. Archit. Lett. 14 (1) (2015)
Joel Hestness, Stephen W. Keckler, David A. Wood
A comparative analysis of microarchitecture effects on CPU and GPU memory system behavior. IISWC (2014)
Boris Grot, Joel Hestness, Stephen W. Keckler, Onur Mutlu
A QoS-Enabled On-Die Interconnect Fabric for Kilo-Node Chips. IEEE Micro 32 (3) (2012)
Boris Grot, Joel Hestness, Stephen W. Keckler, Onur Mutlu
Kilo-NOC: a heterogeneous network-on-chip architecture for scalability and service guarantees. ISCA (2011)
Nathan L. Binkert, Bradford M. Beckmann, Gabriel Black, Steven K. Reinhardt, Ali G. Saidi, Arkaprava Basu, Joel Hestness, Derek Hower, Tushar Krishna, Somayeh Sardashti, Rathijit Sen, Korey Sewell, Muhammad Shoaib Bin Altaf, Nilay Vaish, Mark D. Hill, David A. Wood
The gem5 simulator. SIGARCH Comput. Archit. News 39 (2) (2011)
Joel Hestness, Boris Grot, Stephen W. Keckler
Netrace: dependency-driven trace-based network-on-chip simulation. NoCArc@MICRO (2010)
Boris Grot, Joel Hestness, Stephen W. Keckler, Onur Mutlu
Express Cube Topologies for on-Chip Interconnects. HPCA (2009)