Eric Wallace - RankMe

79 papers A* 17Journal 43Unranked 19

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	Estimating Worst-Case Frontier Risks of Open-Weight LLMs. CoRR Eric Wallace, Olivia Watkins, Miles Wang, Kai Chen, Chris Koch
2025	J	`jnl`	Trading Inference-Time Compute for Adversarial Robustness. CoRR Wojciech Zaremba, Evgenia Nitishinskaya, Boaz Barak, Stephanie Lin, Sam Toyer, Yaodong Yu, Rachel Dias, Eric Wallace, Kai Xiao, Johannes Heidecke, Amelia Glaese
2025	—	`conf`	Unfamiliar Finetuning Examples Control How Language Models Hallucinate. NAACL (Long Papers) Katie Kang, Eric Wallace, Claire J. Tomlin, Aviral Kumar, Sergey Levine
2024	A*	`conf`	Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation. ICML Danny Halawi, Alexander Wei, Eric Wallace, Tony Tong Wang, Nika Haghtalab, Jacob Steinhardt
2024	J	`jnl`	Covert Malicious Finetuning: Challenges in Safeguarding LLM Adaptation. CoRR Danny Halawi, Alexander Wei, Eric Wallace, Tony T. Wang, Nika Haghtalab, Jacob Steinhardt
2024	J	`jnl`	Deliberative Alignment: Reasoning Enables Safer Language Models. CoRR Melody Y. Guan, Manas Joglekar, Eric Wallace, Saachi Jain, Boaz Barak, Alec Helyar, Rachel Dias, Andrea Vallone, Hongyu Ren, Jason Wei, Hyung Won Chung, Sam Toyer, Johannes Heidecke, Alex Beutel, Amelia Glaese
2024	J	`jnl`	Predicting Emergent Capabilities by Finetuning. CoRR Charlie Snell, Eric Wallace, Dan Klein, Sergey Levine
2024	A*	`conf`	Privacy Side Channels in Machine Learning Systems. USENIX Security Symposium Edoardo Debenedetti, Giorgio Severi, Milad Nasr, Christopher A. Choquette-Choo, Matthew Jagielski, Eric Wallace, Nicholas Carlini, Florian Tramèr
2024	A*	`conf`	SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore. ICLR Sewon Min, Suchin Gururangan, Eric Wallace, Weijia Shi, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer
2024	J	`jnl`	Stealing Part of a Production Language Model. CoRR Nicholas Carlini, Daniel Paleka, Krishnamurthy (Dj) Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Eric Wallace, David Rolnick, Florian Tramèr
2024	A*	`conf`	Stealing part of a production language model. ICML Nicholas Carlini, Daniel Paleka, Krishnamurthy Dj Dvijotham, Thomas Steinke, Jonathan Hayase, A. Feder Cooper, Katherine Lee, Matthew Jagielski, Milad Nasr, Arthur Conmy, Eric Wallace, David Rolnick, Florian Tramèr
2024	A*	`conf`	The False Promise of Imitating Proprietary Language Models. ICLR Arnav Gudibande, Eric Wallace, Charlie Snell, Xinyang Geng, Hao Liu, Pieter Abbeel, Sergey Levine, Dawn Song
2024	J	`jnl`	The Instruction Hierarchy: Training LLMs to Prioritize Privileged Instructions. CoRR Eric Wallace, Kai Xiao, Reimar Leike, Lilian Weng, Johannes Heidecke, Alex Beutel
2024	J	`jnl`	Unfamiliar Finetuning Examples Control How Language Models Hallucinate. CoRR Katie Kang, Eric Wallace, Claire J. Tomlin, Aviral Kumar, Sergey Levine
2024	—	`conf`	What Evidence Do Language Models Find Convincing? ACL (1) Alexander Wan, Eric Wallace, Dan Klein
2024	J	`jnl`	What Evidence Do Language Models Find Convincing? CoRR Alexander Wan, Eric Wallace, Dan Klein
2023	A*	`conf`	Extracting Training Data from Diffusion Models. USENIX Security Symposium Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
2023	J	`jnl`	Extracting Training Data from Diffusion Models. CoRR Nicholas Carlini, Jamie Hayes, Milad Nasr, Matthew Jagielski, Vikash Sehwag, Florian Tramèr, Borja Balle, Daphne Ippolito, Eric Wallace
2023	A*	`conf`	InCoder: A Generative Model for Code Infilling and Synthesis. ICLR Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Scott Yih, Luke Zettlemoyer, Mike Lewis
2023	A*	`conf`	Large Language Models Struggle to Learn Long-Tail Knowledge. ICML Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel
2023	A*	`conf`	Measuring Forgetting of Memorized Training Examples. ICLR Matthew Jagielski, Om Thakkar, Florian Tramèr, Daphne Ippolito, Katherine Lee, Nicholas Carlini, Eric Wallace, Shuang Song, Abhradeep Guha Thakurta, Nicolas Papernot, Chiyuan Zhang
2023	A*	`conf`	Poisoning Language Models During Instruction Tuning. ICML Alexander Wan, Eric Wallace, Sheng Shen, Dan Klein
2023	J	`jnl`	Poisoning Language Models During Instruction Tuning. CoRR Alexander Wan, Eric Wallace, Sheng Shen, Dan Klein
2023	J	`jnl`	Privacy Side Channels in Machine Learning Systems. CoRR Edoardo Debenedetti, Giorgio Severi, Nicholas Carlini, Christopher A. Choquette-Choo, Matthew Jagielski, Milad Nasr, Eric Wallace, Florian Tramèr
2023	J	`jnl`	SILO Language Models: Isolating Legal Risk In a Nonparametric Datastore. CoRR Sewon Min, Suchin Gururangan, Eric Wallace, Hannaneh Hajishirzi, Noah A. Smith, Luke Zettlemoyer
2023	J	`jnl`	Scalable Extraction of Training Data from (Production) Language Models. CoRR Milad Nasr, Nicholas Carlini, Jonathan Hayase, Matthew Jagielski, A. Feder Cooper, Daphne Ippolito, Christopher A. Choquette-Choo, Eric Wallace, Florian Tramèr, Katherine Lee
2023	J	`jnl`	The False Promise of Imitating Proprietary LLMs. CoRR Arnav Gudibande, Eric Wallace, Charlie Snell, Xinyang Geng, Hao Liu, Pieter Abbeel, Sergey Levine, Dawn Song
2022	—	`conf`	Analyzing Dynamic Adversarial Training Data in the Limit. ACL (Findings) Eric Wallace, Adina Williams, Robin Jia, Douwe Kiela
2022	—	`conf`	Automated Crossword Solving. ACL (1) Eric Wallace, Nicholas Tomlin, Albert Xu, Kevin Yang, Eshaan Pathak, Matthew L. Ginsberg, Dan Klein
2022	J	`jnl`	Automated Crossword Solving. CoRR Eric Wallace, Nicholas Tomlin, Albert Xu, Kevin Yang, Eshaan Pathak, Matthew L. Ginsberg, Dan Klein
2022	—	`conf`	Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models. ACL (Findings) Robert L. Logan IV, Ivana Balazevic, Eric Wallace, Fabio Petroni, Sameer Singh, Sebastian Riedel
2022	A*	`conf`	Deduplicating Training Data Mitigates Privacy Risks in Language Models. ICML Nikhil Kandpal, Eric Wallace, Colin Raffel
2022	J	`jnl`	Deduplicating Training Data Mitigates Privacy Risks in Language Models. CoRR Nikhil Kandpal, Eric Wallace, Colin Raffel
2022	J	`jnl`	InCoder: A Generative Model for Code Infilling and Synthesis. CoRR Daniel Fried, Armen Aghajanyan, Jessy Lin, Sida Wang, Eric Wallace, Freda Shi, Ruiqi Zhong, Wen-tau Yih, Luke Zettlemoyer, Mike Lewis
2022	J	`jnl`	Large Language Models Struggle to Learn Long-Tail Knowledge. CoRR Nikhil Kandpal, Haikang Deng, Adam Roberts, Eric Wallace, Colin Raffel
2022	J	`jnl`	Measuring Forgetting of Memorized Training Examples. CoRR Matthew Jagielski, Om Thakkar, Florian Tramèr, Daphne Ippolito, Katherine Lee, Nicholas Carlini, Eric Wallace, Shuang Song, Abhradeep Thakurta, Nicolas Papernot, Chiyuan Zhang
2021	J	`jnl`	Analyzing Dynamic Adversarial Training Data in the Limit. CoRR Eric Wallace, Adina Williams, Robin Jia, Douwe Kiela
2021	J	`jnl`	Calibrate Before Use: Improving Few-Shot Performance of Language Models. CoRR Tony Z. Zhao, Eric Wallace, Shi Feng, Dan Klein, Sameer Singh
2021	A*	`conf`	Calibrate Before Use: Improving Few-shot Performance of Language Models. ICML Zihao Zhao, Eric Wallace, Shi Feng, Dan Klein, Sameer Singh
2021	—	`conf`	Concealed Data Poisoning Attacks on NLP Models. NAACL-HLT Eric Wallace, Tony Z. Zhao, Shi Feng, Sameer Singh
2021	J	`jnl`	Cutting Down on Prompts and Parameters: Simple Few-Shot Learning with Language Models. CoRR Robert L. Logan IV, Ivana Balazevic, Eric Wallace, Fabio Petroni, Sameer Singh, Sebastian Riedel
2021	—	`conf`	Detoxifying Language Models Risks Marginalizing Minority Voices. NAACL-HLT Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein
2021	J	`jnl`	Detoxifying Language Models Risks Marginalizing Minority Voices. CoRR Albert Xu, Eshaan Pathak, Eric Wallace, Suchin Gururangan, Maarten Sap, Dan Klein
2021	A*	`conf`	Extracting Training Data from Large Language Models. USENIX Security Symposium Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, Colin Raffel
2020	—	`conf`	AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. EMNLP (1) Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace, Sameer Singh
2020	J	`jnl`	AutoPrompt: Eliciting Knowledge from Language Models with Automatically Generated Prompts. CoRR Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace, Sameer Singh
2020	J	`jnl`	Customizing Triggers with Concealed Data Poisoning. CoRR Eric Wallace, Tony Z. Zhao, Shi Feng, Sameer Singh
2020	—	`conf`	Evaluating Models' Local Decision Boundaries via Contrast Sets. EMNLP (Findings) Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hannaneh Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
2020	J	`jnl`	Evaluating NLP Models via Contrast Sets. CoRR Matt Gardner, Yoav Artzi, Victoria Basmova, Jonathan Berant, Ben Bogin, Sihao Chen, Pradeep Dasigi, Dheeru Dua, Yanai Elazar, Ananth Gottumukkala, Nitish Gupta, Hanna Hajishirzi, Gabriel Ilharco, Daniel Khashabi, Kevin Lin, Jiangming Liu, Nelson F. Liu, Phoebe Mulcaire, Qiang Ning, Sameer Singh, Noah A. Smith, Sanjay Subramanian, Reut Tsarfaty, Eric Wallace, Ally Zhang, Ben Zhou
2020	J	`jnl`	Extracting Training Data from Large Language Models. CoRR Nicholas Carlini, Florian Tramèr, Eric Wallace, Matthew Jagielski, Ariel Herbert-Voss, Katherine Lee, Adam Roberts, Tom B. Brown, Dawn Song, Úlfar Erlingsson, Alina Oprea, Colin Raffel
2020	—	`conf`	Gradient-based Analysis of NLP Models is Manipulable. EMNLP (Findings) Junlin Wang, Jens Tuyls, Eric Wallace, Sameer Singh
2020	J	`jnl`	Gradient-based Analysis of NLP Models is Manipulable. CoRR Junlin Wang, Jens Tuyls, Eric Wallace, Sameer Singh
2020	—	`conf`	Imitation Attacks and Defenses for Black-box Machine Translation Systems. EMNLP (1) Eric Wallace, Mitchell Stern, Dawn Song
2020	J	`jnl`	Imitation Attacks and Defenses for Black-box Machine Translation Systems. CoRR Eric Wallace, Mitchell Stern, Dawn Song
2020	—	`conf`	Interpreting Predictions of NLP Models. EMNLP (Tutorial Abstracts) Eric Wallace, Matt Gardner, Sameer Singh
2020	A*	`conf`	Pretrained Transformers Improve Out-of-Distribution Robustness. ACL Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, Adam Dziedzic, Rishabh Krishnan, Dawn Song
2020	J	`jnl`	Pretrained Transformers Improve Out-of-Distribution Robustness. CoRR Dan Hendrycks, Xiaoyuan Liu, Eric Wallace, Adam Dziedzic, Rishabh Krishnan, Dawn Song
2020	A*	`conf`	Train Big, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers. ICML Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joey Gonzalez
2020	J	`jnl`	Train Large, Then Compress: Rethinking Model Size for Efficient Training and Inference of Transformers. CoRR Zhuohan Li, Eric Wallace, Sheng Shen, Kevin Lin, Kurt Keutzer, Dan Klein, Joseph E. Gonzalez
2020	J	`jnl`	Trustworthy AI Inference Systems: An Industry Research View. CoRR Rosario Cammarota, Matthias Schunter, Anand Rajan, Fabian Boemer, Ágnes Kiss, Amos Treiber, Christian Weinert, Thomas Schneider, Emmanuel Stapf, Ahmad-Reza Sadeghi, Daniel Demmler, Huili Chen, Siam Umar Hussain, M. Sadegh Riazi, Farinaz Koushanfar, Saransh Gupta, Tajana Simunic Rosing, Kamalika Chaudhuri, Hamid Nejatollahi, Nikil D. Dutt, Mohsen Imani, Kim Laine, Anuj Dubey, Aydin Aysu, Fateme Sadat Hosseini, Chengmo Yang, Eric Wallace, Pamela Norton
2019	—	`conf`	AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models. EMNLP/IJCNLP (3) Eric Wallace, Jens Tuyls, Junlin Wang, Sanjay Subramanian, Matt Gardner, Sameer Singh
2019	J	`jnl`	AllenNLP Interpret: A Framework for Explaining Predictions of NLP Models. CoRR Eric Wallace, Jens Tuyls, Junlin Wang, Sanjay Subramanian, Matt Gardner, Sameer Singh
2019	—	`conf`	Compositional Questions Do Not Necessitate Multi-hop Reasoning. ACL (1) Sewon Min, Eric Wallace, Sameer Singh, Matt Gardner, Hannaneh Hajishirzi, Luke Zettlemoyer
2019	J	`jnl`	Compositional Questions Do Not Necessitate Multi-hop Reasoning. CoRR Sewon Min, Eric Wallace, Sameer Singh, Matt Gardner, Hannaneh Hajishirzi, Luke Zettlemoyer
2019	—	`conf`	Do NLP Models Know Numbers? Probing Numeracy in Embeddings. EMNLP/IJCNLP (1) Eric Wallace, Yizhong Wang, Sujian Li, Sameer Singh, Matt Gardner
2019	J	`jnl`	Do NLP Models Know Numbers? Probing Numeracy in Embeddings. CoRR Eric Wallace, Yizhong Wang, Sujian Li, Sameer Singh, Matt Gardner
2019	—	`conf`	Misleading Failures of Partial-input Baselines. ACL (1) Shi Feng, Eric Wallace, Jordan L. Boyd-Graber
2019	J	`jnl`	Misleading Failures of Partial-input Baselines. CoRR Shi Feng, Eric Wallace, Jordan L. Boyd-Graber
2019	J	`jnl`	Trick Me If You Can: Human-in-the-loop Generation of Adversarial Question Answering Examples. Trans. Assoc. Comput. Linguistics Eric Wallace, Pedro Rodriguez, Shi Feng, Ikuya Yamada, Jordan L. Boyd-Graber
2019	A*	`conf`	Understanding Impacts of High-Order Loss Approximations and Features in Deep Learning Interpretation. ICML Sahil Singla, Eric Wallace, Shi Feng, Soheil Feizi
2019	J	`jnl`	Understanding Impacts of High-Order Loss Approximations and Features in Deep Learning Interpretation. CoRR Sahil Singla, Eric Wallace, Shi Feng, Soheil Feizi
2019	—	`conf`	Universal Adversarial Triggers for Attacking and Analyzing NLP. EMNLP/IJCNLP (1) Eric Wallace, Shi Feng, Nikhil Kandpal, Matt Gardner, Sameer Singh
2019	J	`jnl`	Universal Adversarial Triggers for NLP. CoRR Eric Wallace, Shi Feng, Nikhil Kandpal, Matt Gardner, Sameer Singh
2018	J	`jnl`	Interpreting Neural Networks With Nearest Neighbors. CoRR Eric Wallace, Shi Feng, Jordan L. Boyd-Graber
2018	—	`conf`	Interpreting Neural Networks with Nearest Neighbors. BlackboxNLP@EMNLP Eric Wallace, Shi Feng, Jordan L. Boyd-Graber
2018	A*	`conf`	Pathologies of Neural Models Make Interpretation Difficult. EMNLP Shi Feng, Eric Wallace, Alvin Grissom II, Mohit Iyyer, Pedro Rodriguez, Jordan L. Boyd-Graber
2018	J	`jnl`	Right Answer for the Wrong Reason: Discovery and Mitigation. CoRR Shi Feng, Eric Wallace, Mohit Iyyer, Pedro Rodriguez, Alvin Grissom II, Jordan L. Boyd-Graber
2018	—	`conf`	Trick Me If You Can: Adversarial Writing of Trivia Challenge Questions. ACL (3) Eric Wallace, Jordan L. Boyd-Graber
2018	J	`jnl`	Trick Me If You Can: Adversarial Writing of Trivia Challenge Questions. CoRR Eric Wallace, Pedro Rodriguez, Shi Feng, Jordan L. Boyd-Graber