Jacob Portes

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 5

Top Topics

Adaptive Learning Rate

Video Compression

Evaluation Measures

Uniform Convergence

Top Venues

Publications

Dan Biderman, Jose Javier Gonzalez Ortiz, Jacob Portes, Mansheej Paul, Philip Greengard, Connor Jennings, Daniel King, Sam Havens, Vitaliy Chiley, Jonathan Frankle, Cody Blakeney, John P. Cunningham
LoRA Learns Less and Forgets Less. CoRR (2024)
Jacob Portes, Alexander Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining. NeurIPS (2023)
Jacob Portes, Alex Trott, Sam Havens, Daniel King, Abhinav Venigalla, Moin Nadeem, Nikhil Sardana, Daya Khudia, Jonathan Frankle
MosaicBERT: A Bidirectional Encoder Optimized for Fast Pretraining. CoRR (2023)
Aditi Jha, Sam Havens, Jeremy Dohmann, Alex Trott, Jacob Portes
LIMIT: Less Is More for Instruction Tuning Across Evaluation Paradigms. CoRR (2023)
Jacob Portes, Davis W. Blalock, Cory Stephenson, Jonathan Frankle
Fast Benchmarking of Accuracy vs. Training Time with Cyclic Learning Rates. CoRR (2022)