Abhinav Venigalla

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 7

Top Topics

Backpropagation Algorithm

Feed Forward Neural Networks

Biomedical Text

Neural Network Training

Top Venues

Publications

Elliot Bolton, Abhinav Venigalla, Michihiro Yasunaga, David Hall, Betty Xiong, Tony Lee, Roxana Daneshjou, Jonathan Frankle, Percy Liang, Michael Carbin, Christopher D. Manning
BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text. CoRR (2024)
Jacob Portes, Alexander Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining. NeurIPS (2023)
Jacob Portes, Alex Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining. CoRR (2023)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. MLSys (2021)
Valentina Popescu, Abhinav Venigalla, Di Wu, Robert Schreiber
Representation range needs for 16-bit neural network training. CoRR (2021)
Atli Kosson, Vitaliy Chiley, Abhinav Venigalla, Joel Hestness, Urs Köster
Pipelined Backpropagation at Scale: Training Large Models without Batches. CoRR (2020)
Abhinav Venigalla, Atli Kosson, Vitaliy Chiley, Urs Köster
Adaptive Braking for Mitigating Gradient Delay. CoRR (2020)