Rylan Schaeffer

55 papers A* 13A 1Journal 40Unranked 1

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Consensus is Not Verification: Why Crowd Wisdom Strategies Fail for LLM Truthfulness. CoRR Yegor Denisov-Blanch, Joshua Kazdan, Jessica Chudnovsky, Rylan Schaeffer, Sheng Guan, Soji Adeshina, Sanmi Koyejo
2026	J	`jnl`	Quantifying the Effect of Test Set Contamination on Generative Evaluations. CoRR Rylan Schaeffer, Joshua Kazdan, Baber Abbasi, Ken Ziyu Liu, Brando Miranda, Ahmed Ahmed, Abhay Puri, Niloofar Mireshghallah, Sanmi Koyejo
2026	J	`jnl`	Scale Dependent Data Duplication. CoRR Joshua Kazdan, Noam Levi, Rylan Schaeffer, Jessica Chudnovsky, Abhay Puri, Bo He, Mehmet Donmez, Sanmi Koyejo, David L. Donoho
2025	J	`jnl`	Chain-of-Thought Hijacking. CoRR Jianli Zhao, Tingchen Fu, Rylan Schaeffer, Mrinank Sharma, Fazl Barez
2025	A*	`conf`	Collapse or Thrive: Perils and Promises of Synthetic Data in a Self-Generating World. ICML Joshua Kazdan, Rylan Schaeffer, Apratim Dey, Matthias Gerstgrasser, Rafael Rafailov, David L. Donoho, Sanmi Koyejo
2025	J	`jnl`	Correlating and Predicting Human Evaluations of Language Models from Natural Language Processing Benchmarks. CoRR Rylan Schaeffer, Punit Singh Koura, Binh Tang, Ranjan Subramanian, Aaditya K. Singh, Todor Mihaylov, Prajjwal Bhargava, Lovish Madaan, Niladri S. Chatterji, Vedanuj Goswami, Sergey Edunov, Dieuwke Hupkes, Sanmi Koyejo, Sharan Narang
2025	J	`jnl`	Efficient Prediction of Pass@k Scaling in Large Language Models. CoRR Joshua Kazdan, Rylan Schaeffer, Youssef Allouah, Colin Sullivan, Kyssen Yu, Noam Levi, Sanmi Koyejo
2025	J	`jnl`	Evaluating the Robustness of Chinchilla Compute-Optimal Scaling. CoRR Rylan Schaeffer, Noam Levi, Andreas Kirsch, Theo Guenais, Brando Miranda, Elyas Obbad, Sanmi Koyejo
2025	A*	`conf`	Failures to Find Transferable Image Jailbreaks Between Vision-Language Models. ICLR Rylan Schaeffer, Dan Valentine, Luke Bailey, James Chua, Cristóbal Eyzaguirre, Zane Durante, Joe Benton, Brando Miranda, Henry Sleight, Tony Tong Wang, John Hughes, Rajashree Agrawal, Mrinank Sharma, Scott Emmons, Sanmi Koyejo, Ethan Perez
2025	A*	`conf`	How Do Large Language Monkeys Get Their Power (Laws)? ICML Rylan Schaeffer, Joshua Kazdan, John Hughes, Jordan Juravsky, Sara Price, Aengus Lynch, Erik Jones, Robert Kirk, Azalia Mirhoseini, Sanmi Koyejo
2025	J	`jnl`	How Do Large Language Monkeys Get Their Power (Laws)? CoRR Rylan Schaeffer, Joshua Kazdan, John Hughes, Jordan Juravsky, Sara Price, Aengus Lynch, Erik Jones, Robert Kirk, Azalia Mirhoseini, Sanmi Koyejo
2025	J	`jnl`	Min-p, Max Exaggeration: A Critical Analysis of Min-p Sampling in Language Models. CoRR Rylan Schaeffer, Joshua Kazdan, Yegor Denisov-Blanch
2025	J	`jnl`	No, of course I can! Refusal Mechanisms Can Be Exploited Using Harmless Fine-Tuning Data. CoRR Joshua Kazdan, Lisa Yu, Rylan Schaeffer, Chris Cundy, Sanmi Koyejo, Dvijotham Krishnamurthy
2025	J	`jnl`	Open Problems in Technical AI Governance. Trans. Mach. Learn. Res. Anka Reuel, Benjamin Bucknall, Stephen Casper, Timothy Fist, Lisa Soder, Onni Aarne, Lewis Hammond, Lujain Ibrahim, Alan Chan, Peter Wills, Markus Anderljung, Ben Garfinkel, Lennart Heim, Andrew Trask, Gabriel Mukobi, Rylan Schaeffer, Mauricio Baker, Sara Hooker, Irene Solaiman, Sasha Luccioni, Nitarshan Rajkumar, Nicolas Moës, Jeffrey Ladish, David Bau, Paul Bricman, Neel Guha, Jessica Newman, Yoshua Bengio, Tobin South, Alex Pentland, Sanmi Koyejo, Mykel J. Kochenderfer, Robert Trager
2025	J	`jnl`	Position: Machine Learning Conferences Should Establish a "Refutations and Critiques" Track. CoRR Rylan Schaeffer, Joshua Kazdan, Yegor Denisov-Blanch, Brando Miranda, Matthias Gerstgrasser, Susan Zhang, Andreas Haupt, Isha Gupta, Elyas Obbad, Jesse Dodge, Jessica Zosa Forde, Koustuv Sinha, Francesco Orabona, Sanmi Koyejo, David L. Donoho
2025	J	`jnl`	Position: Model Collapse Does Not Mean What You Think. CoRR Rylan Schaeffer, Joshua Kazdan, Alvan Caleb Arulandu, Sanmi Koyejo
2025	J	`jnl`	Pretraining Scaling Laws for Generative Evaluations of Language Models. CoRR Rylan Schaeffer, Noam Levi, Brando Miranda, Sanmi Koyejo
2025	A*	`conf`	Uncovering Latent Memories in Large Language Models. ICLR Sunny Duan, Mikail Khona, Abhiram Iyer, Rylan Schaeffer, Ila R. Fiete
2025	J	`jnl`	Understanding Adversarial Transfer: Why Representation-Space Attacks Fail Where Data-Space Attacks Succeed. CoRR Isha Gupta, Rylan Schaeffer, Joshua Kazdan, Ken Ziyu Liu, Sanmi Koyejo
2025	A*	`conf`	Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive? ICML Rylan Schaeffer, Hailey Schoelkopf, Brando Miranda, Gabriel Mukobi, Varun Madan, Adam Ibrahim, Herbie Bradley, Stella Biderman, Sanmi Koyejo
2024	J	`jnl`	Best-of-N Jailbreaking. CoRR John Hughes, Sara Price, Aengus Lynch, Rylan Schaeffer, Fazl Barez, Sanmi Koyejo, Henry Sleight, Erik Jones, Ethan Perez, Mrinank Sharma
2024	J	`jnl`	Bridging Associative Memory and Probabilistic Modeling. CoRR Rylan Schaeffer, Nika Zahedi, Mikail Khona, Dhruv Pai, Sang T. Truong, Yilun Du, Mitchell Ostrow, Sarthak Chandra, Andres Carranza, Ila Rani Fiete, Andrey Gromov, Sanmi Koyejo
2024	J	`jnl`	Collapse or Thrive? Perils and Promises of Synthetic Data in a Self-Generating World. CoRR Joshua Kazdan, Rylan Schaeffer, Apratim Dey, Matthias Gerstgrasser, Rafael Rafailov, David L. Donoho, Sanmi Koyejo
2024	J	`jnl`	In-Context Learning of Energy Functions. CoRR Rylan Schaeffer, Mikail Khona, Sanmi Koyejo
2024	J	`jnl`	Investigating Data Contamination for Pre-training Language Models. CoRR Minhao Jiang, Ken Ziyu Liu, Ming Zhong, Rylan Schaeffer, Siru Ouyang, Jiawei Han, Sanmi Koyejo
2024	J	`jnl`	Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data. CoRR Matthias Gerstgrasser, Rylan Schaeffer, Apratim Dey, Rafael Rafailov, Henry Sleight, John Hughes, Tomasz Korbak, Rajashree Agrawal, Dhruv Pai, Andrey Gromov, Daniel A. Roberts, Diyi Yang, David L. Donoho, Sanmi Koyejo
2024	J	`jnl`	Jailbreak Defense in a Narrow Domain: Limitations of Existing Methods and a New Transcript-Classifier Approach. CoRR Tony T. Wang, John Hughes, Henry Sleight, Rylan Schaeffer, Rajashree Agrawal, Fazl Barez, Mrinank Sharma, Jesse Mu, Nir Shavit, Ethan Perez
2024	A*	`conf`	Many-shot Jailbreaking. NeurIPS Cem Anil, Esin Durmus, Nina Panickssery, Mrinank Sharma, Joe Benton, Sandipan Kundu, Joshua Batson, Meg Tong, Jesse Mu, Daniel Ford, Francesco Mosconi, Rajashree Agrawal, Rylan Schaeffer, Naomi Bashkansky, Samuel Svenningsen, Mike Lambert, Ansh Radhakrishnan, Carson Denison, Evan Hubinger, Yuntao Bai, Trenton Bricken, Timothy Maxwell, Nicholas Schiefer, James Sully, Alex Tamkin, Tamera Lanham, Karina Nguyen, Tomek Korbak, Jared Kaplan, Deep Ganguli, Samuel R. Bowman, Ethan Perez, Roger B. Grosse, David Kristjanson Duvenaud
2024	J	`jnl`	Open Problems in Technical AI Governance. CoRR Anka Reuel, Ben Bucknall, Stephen Casper, Timothy Fist, Lisa Soder, Onni Aarne, Lewis Hammond, Lujain Ibrahim, Alan Chan, Peter Wills, Markus Anderljung, Ben Garfinkel, Lennart Heim, Andrew Trask, Gabriel Mukobi, Rylan Schaeffer, Mauricio Baker, Sara Hooker, Irene Solaiman, Alexandra Sasha Luccioni, Nitarshan Rajkumar, Nicolas Moës, Jeffrey Ladish, Neel Guha, Jessica Newman, Yoshua Bengio, Tobin South, Alex Pentland, Sanmi Koyejo, Mykel J. Kochenderfer, Robert Trager
2024	J	`jnl`	Quantifying Variance in Evaluation Benchmarks. CoRR Lovish Madaan, Aaditya K. Singh, Rylan Schaeffer, Andrew Poulton, Sanmi Koyejo, Pontus Stenetorp, Sharan Narang, Dieuwke Hupkes
2024	J	`jnl`	Towards an Improved Understanding and Utilization of Maximum Manifold Capacity Representations. CoRR Rylan Schaeffer, Victor Lecomte, Dhruv Bhandarkar Pai, Andres Carranza, Berivan Isik, Alyssa Unell, Mikail Khona, Thomas E. Yerxa, Yann LeCun, SueYeon Chung, Andrey Gromov, Ravid Shwartz-Ziv, Sanmi Koyejo
2024	J	`jnl`	Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Large Language Models. CoRR Sunny Duan, Mikail Khona, Abhiram Iyer, Rylan Schaeffer, Ila R. Fiete
2024	J	`jnl`	When Do Universal Image Jailbreaks Transfer Between Vision-Language Models? CoRR Rylan Schaeffer, Dan Valentine, Luke Bailey, James Chua, Cristóbal Eyzaguirre, Zane Durante, Joe Benton, Brando Miranda, Henry Sleight, John Hughes, Rajashree Agrawal, Mrinank Sharma, Scott Emmons, Sanmi Koyejo, Ethan Perez
2024	J	`jnl`	Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive? CoRR Rylan Schaeffer, Hailey Schoelkopf, Brando Miranda, Gabriel Mukobi, Varun Madan, Adam Ibrahim, Herbie Bradley, Stella Biderman, Sanmi Koyejo
2024	J	`jnl`	ZIP-FIT: Embedding-Free Data Selection via Compression-Based Alignment. CoRR Elyas Obbad, Iddah Mlauzi, Brando Miranda, Rylan Schaeffer, Kamal Obbad, Suhana Bedi, Sanmi Koyejo
2023	A*	`conf`	Are Emergent Abilities of Large Language Models a Mirage? NeurIPS Rylan Schaeffer, Brando Miranda, Sanmi Koyejo
2023	J	`jnl`	Are Emergent Abilities of Large Language Models a Mirage? CoRR Rylan Schaeffer, Brando Miranda, Sanmi Koyejo
2023	J	`jnl`	Deceptive Alignment Monitoring. CoRR Andres Carranza, Dhruv Pai, Rylan Schaeffer, Arnuv Tandon, Sanmi Koyejo
2023	A*	`conf`	DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models. NeurIPS Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, Sang T. Truong, Simran Arora, Mantas Mazeika, Dan Hendrycks, Zinan Lin, Yu Cheng, Sanmi Koyejo, Dawn Song, Bo Li
2023	J	`jnl`	DecodingTrust: A Comprehensive Assessment of Trustworthiness in GPT Models. CoRR Boxin Wang, Weixin Chen, Hengzhi Pei, Chulin Xie, Mintong Kang, Chenhui Zhang, Chejian Xu, Zidi Xiong, Ritik Dutta, Rylan Schaeffer, Sang T. Truong, Simran Arora, Mantas Mazeika, Dan Hendrycks, Zinan Lin, Yu Cheng, Sanmi Koyejo, Dawn Song, Bo Li
2023	J	`jnl`	Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle. CoRR Rylan Schaeffer, Mikail Khona, Zachary Robertson, Akhilan Boopathy, Kateryna Pistunova, Jason W. Rocks, Ila Rani Fiete, Oluwasanmi Koyejo
2023	A*	`conf`	Emergence of Sparse Representations from Noise. ICML Trenton Bricken, Rylan Schaeffer, Bruno A. Olshausen, Gabriel Kreiman
2023	J	`jnl`	FACADE: A Framework for Adversarial Circuit Anomaly Detection and Evaluation. CoRR Dhruv Pai, Andres Carranza, Rylan Schaeffer, Arnuv Tandon, Sanmi Koyejo
2023	J	`jnl`	Incidental Polysemanticity. CoRR Victor Lecomte, Kushal Thaman, Trevor Chow, Rylan Schaeffer, Sanmi Koyejo
2023	J	`jnl`	Invalid Logic, Equivalent Gains: The Bizarreness of Reasoning in Language Model Prompting. CoRR Rylan Schaeffer, Kateryna Pistunova, Samar Khanna, Sarthak Consul, Sanmi Koyejo
2023	J	`jnl`	Pretraining on the Test Set Is All You Need. CoRR Rylan Schaeffer
2023	A*	`conf`	Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells. NeurIPS Rylan Schaeffer, Mikail Khona, Tzuhsuan Ma, Cristóbal Eyzaguirre, Sanmi Koyejo, Ila Fiete
2023	J	`jnl`	Self-Supervised Learning of Representations for Space Generates Multi-Modular Grid Cells. CoRR Rylan Schaeffer, Mikail Khona, Tzuhsuan Ma, Cristóbal Eyzaguirre, Sanmi Koyejo, Ila Rani Fiete
2022	A*	`conf`	No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit. NeurIPS Rylan Schaeffer, Mikail Khona, Ila Fiete
2022	A*	`conf`	Streaming Inference for Infinite Feature Models. ICML Rylan Schaeffer, Yilun Du, Gabrielle K. Liu, Ila Fiete
2022	—	`conf`	Streaming Inference for Infinite Non-Stationary Clustering. CoLLAs Rylan Schaeffer, Gabrielle Kaili-May Liu, Yilun Du, Scott Linderman, Ila Rani Fiete
2022	J	`jnl`	Streaming Inference for Infinite Non-Stationary Clustering. CoRR Rylan Schaeffer, Gabrielle Kaili-May Liu, Yilun Du, Scott Linderman, Ila Rani Fiete
2021	J	`jnl`	An Algorithmic Theory of Metacognition in Minds and Machines. CoRR Rylan Schaeffer
2021	A	`conf`	Efficient online inference for nonparametric mixture models. UAI Rylan Schaeffer, Blake Bordelon, Mikail Khona, Weiwei Pan, Ila Rani Fiete
2020	A*	`conf`	Reverse-engineering recurrent neural network solutions to a hierarchical inference task for mice. NeurIPS Rylan Schaeffer, Mikail Khona, Leenoy Meshulam, International Brain Laboratory, Ila Fiete