Aaditya K. Singh

Publication Activity (10 Years)

Years Active: 2022-2024
Publications (10 Years): 11

Top Topics

Biomedical Text

Character N Grams

Top Venues

Publications

Aaditya K. Singh, DJ Strouse
Tokenization counts: the impact of tokenization on arithmetic in frontier LLMs. CoRR (2024)
Lovish Madaan, Aaditya K. Singh, Rylan Schaeffer, Andrew Poulton, Sanmi Koyejo, Pontus Stenetorp, Sharan Narang, Dieuwke Hupkes
Quantifying Variance in Evaluation Benchmarks. CoRR (2024)
Ted Moskovitz, Aaditya K. Singh, DJ Strouse, Tuomas Sandholm, Ruslan Salakhutdinov, Anca D. Dragan, Stephen Marcus McAleer
Confronting Reward Model Overoptimization with Constrained RLHF. ICLR (2024)
Aaditya K. Singh, Ted Moskovitz, Felix Hill, Stephanie C. Y. Chan, Andrew M. Saxe
What needs to go right for an induction head? A mechanistic study of in-context learning circuits and their formation. CoRR (2024)
Aaditya K. Singh, Yu Yang, Kushal Tirumala, Mostafa Elhoushi, Ari S. Morcos
Brevity is the soul of wit: Pruning long files for code generation. CoRR (2024)
Ted Moskovitz, Aaditya K. Singh, DJ Strouse, Tuomas Sandholm, Ruslan Salakhutdinov, Anca D. Dragan, Stephen McAleer
Confronting Reward Model Overoptimization with Constrained RLHF. CoRR (2023)
Aaditya K. Singh, Stephanie C. Y. Chan, Ted Moskovitz, Erin Grant, Andrew M. Saxe, Felix Hill
The Transient Nature of Emergent In-Context Learning in Transformers. NeurIPS (2023)
Aaditya K. Singh, Stephanie C. Y. Chan, Ted Moskovitz, Erin Grant, Andrew M. Saxe, Felix Hill
The Transient Nature of Emergent In-Context Learning in Transformers. CoRR (2023)
Yu Yang, Aaditya K. Singh, Mostafa Elhoushi, Anas Mahmoud, Kushal Tirumala, Fabian Gloeckle, Baptiste Rozière, Carole-Jean Wu, Ari S. Morcos, Newsha Ardalani
Decoding Data Quality via Synthetic Corruptions: Embedding-guided Pruning of Code Data. CoRR (2023)
Aaditya K. Singh, David Ding, Andrew Saxe, Felix Hill, Andrew K. Lampinen
Know your audience: specializing grounded language models with listener subtraction. EACL (2023)
Aaditya K. Singh, David Ding, Andrew Saxe, Felix Hill, Andrew K. Lampinen
Know your audience: specializing grounded language models with the game of Dixit. CoRR (2022)