Rylan Schaeffer

Publication Activity (10 Years)

Years Active: 2020-2024
Publications (10 Years): 30

Top Topics

Associative Memory

Probabilistic Model

Top Venues

Publications

Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel A. Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo
Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data. CoRR (2024)
Lovish Madaan, Aaditya K. Singh, Rylan Schaeffer, Andrew Poulton, Sanmi Koyejo, Pontus Stenetorp, Sharan Narang, Dieuwke Hupkes
Quantifying Variance in Evaluation Benchmarks. CoRR (2024)
Sunny Duan, Mikail Khona, Abhiram Iyer, Rylan Schaeffer, Ila R. Fiete
Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Large Language Models. CoRR (2024)
Rylan Schaeffer, Nika Zahedi, Mikail Khona, Dhruv Pai, Sang T. Truong, Yilun Du, Mitchell Ostrow, Sarthak Chandra, Andres Carranza, Ila Rani Fiete, Andrey Gromov, Sanmi Koyejo
Bridging Associative Memory and Probabilistic Modeling. CoRR (2024)
Minhao Jiang, Ken Ziyu Liu, Ming Zhong, Rylan Schaeffer, Siru Ouyang, Jiawei Han, Sanmi Koyejo
Investigating Data Contamination for Pre-training Language Models. CoRR (2024)
Anka Reuel, Ben Bucknall, Stephen Casper, Tim Fist, Lisa Soder, Onni Aarne, Lewis Hammond, Lujain Ibrahim, Alan Chan, Peter Wills, Markus Anderljung, Ben Garfinkel, Lennart Heim, Andrew Trask, Gabriel Mukobi, Rylan Schaeffer, Mauricio Baker, Sara Hooker, Irene Solaiman, Alexandra Sasha Luccioni, Nitarshan Rajkumar, Nicolas Moës, Jeffrey Ladish, Neel Guha, Jessica Newman, Yoshua Bengio, Tobin South, Alex Pentland, Sanmi Koyejo, Mykel J. Kochenderfer, Robert Trager
Open Problems in Technical AI Governance. CoRR (2024)
Rylan Schaeffer, Hailey Schoelkopf, Brando Miranda, Gabriel Mukobi, Varun Madan, Adam Ibrahim, Herbie Bradley, Stella Biderman, Sanmi Koyejo
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive? CoRR (2024)
Rylan Schaeffer, Victor Lecomte, Dhruv Bhandarkar Pai, Andres Carranza, Berivan Isik, Alyssa Unell, Mikail Khona, Thomas E. Yerxa, Yann LeCun, SueYeon Chung, Andrey Gromov, Ravid Shwartz-Ziv, Sanmi Koyejo
Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations. CoRR (2024)
Rylan Schaeffer, Dan Valentine, Luke Bailey, James Chua, Cristóbal Eyzaguirre, Zane Durante, Joe Benton, Brando Miranda, Henry Sleight, John Hughes, Rajashree Agrawal, Mrinank Sharma, Scott Emmons, Sanmi Koyejo, Ethan Perez
When Do Universal Image Jailbreaks Transfer Between Vision-Language Models? CoRR (2024)
Rylan Schaeffer, Mikail Khona, Sanmi Koyejo
In-Context Learning of Energy Functions. CoRR (2024)
Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, Sang T. Truong, Simran Arora, Mantas Mazeika, Dan Hendrycks, Zinan Lin, Yu Cheng, Sanmi Koyejo, Dawn Song, Bo Li
DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models. CoRR (2023)
Trenton Bricken, Rylan Schaeffer, Bruno A. Olshausen, Gabriel Kreiman
Emergence of Sparse Representations from Noise. ICML (2023)
Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, Sang T. Truong, Simran Arora, Mantas Mazeika, Dan Hendrycks, Zinan Lin, Yu Cheng, Sanmi Koyejo, Dawn Song, Bo Li
DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models. NeurIPS (2023)
Rylan Schaeffer, Mikail Khona, Zachary Robertson, Akhilan Boopathy, Kateryna Pistunova, Jason W. Rocks, Ila Rani Fiete, Oluwasanmi Koyejo
Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle. CoRR (2023)
Rylan Schaeffer, Brando Miranda, Sanmi Koyejo
Are Emergent Abilities of Large Language Models a Mirage? CoRR (2023)
Dhruv Pai, Andres Carranza, Rylan Schaeffer, Arnuv Tandon, Sanmi Koyejo
FACADE: A Framework for Adversarial Circuit Anomaly Detection and Evaluation. CoRR (2023)
Victor Lecomte, Kushal Thaman, Trevor Chow, Rylan Schaeffer, Sanmi Koyejo
Incidental Polysemanticity. CoRR (2023)
Andres Carranza, Dhruv Pai, Rylan Schaeffer, Arnuv Tandon, Sanmi Koyejo
Deceptive Alignment Monitoring. CoRR (2023)
Rylan Schaeffer, Brando Miranda, Sanmi Koyejo
Are Emergent Abilities of Large Language Models a Mirage? NeurIPS (2023)
Rylan Schaeffer
Pretraining on the Test Set Is All You Need. CoRR (2023)
Rylan Schaeffer, Mikail Khona, Tzuhsuan Ma, Cristóbal Eyzaguirre, Sanmi Koyejo, Ila Fiete
Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells. NeurIPS (2023)
Rylan Schaeffer, Mikail Khona, Tzuhsuan Ma, Cristóbal Eyzaguirre, Sanmi Koyejo, Ila Rani Fiete
Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells. CoRR (2023)
Rylan Schaeffer, Kateryna Pistunova, Samar Khanna, Sarthak Consul, Sanmi Koyejo
Invalid Logic, Equivalent Gains: The Bizarreness of Reasoning in Language Model Prompting. CoRR (2023)
Rylan Schaeffer, Gabrielle Kaili-May Liu, Yilun Du, Scott Linderman, Ila Rani Fiete
Streaming Inference for Infinite Non-Stationary Clustering. CoRR (2022)
Rylan Schaeffer, Yilun Du, Gabrielle K. Liu, Ila Fiete
Streaming Inference for Infinite Feature Models. ICML (2022)
Rylan Schaeffer, Gabrielle Kaili-May Liu, Yilun Du, Scott Linderman, Ila Rani Fiete
Streaming Inference for Infinite Non-Stationary Clustering. CoLLAs (2022)
Rylan Schaeffer, Mikail Khona, Ila Fiete
No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit. NeurIPS (2022)
Rylan Schaeffer, Blake Bordelon, Mikail Khona, Weiwei Pan, Ila Rani Fiete
Efficient online inference for nonparametric mixture models. UAI (2021)
Rylan Schaeffer
An Algorithmic Theory of Metacognition in Minds and Machines. CoRR (2021)
Rylan Schaeffer, Mikail Khona, Leenoy Meshulam, International Brain Laboratory, Ila Fiete
Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice. NeurIPS (2020)