Andrew M. Bean

18 papers A* 4Journal 13Unranked 1

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	Clinical knowledge in LLMs does not translate to human interactions. CoRR Andrew M. Bean, Rebecca Payne, Guy Parsons, Hannah Rose Kirk, Juan Ciro, Rafael Mosquera, Sara Hincapié Monsalve, Aruna S. Ekanayaka, Lionel Tarassenko, Luc Rocher, Adam Mahdi
2025	J	`jnl`	LINGOLY-TOO: Disentangling Memorisation from Reasoning with Linguistic Templatisation and Orthographic Obfuscation. CoRR Jude Khouja, Karolina Korgul, Simi Hellsten, Lingyi Yang, Vlad Neacsu, Harry Mayne, Ryan Kearns, Andrew M. Bean, Adam Mahdi
2025	A*	`conf`	LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations. EMNLP Harry Mayne, Ryan Othniel Kearns, Yushi Yang, Andrew M. Bean, Eoin D. Delaney, Chris Russell, Adam Mahdi
2025	J	`jnl`	LLMs Don't Know Their Own Decision Boundaries: The Unreliability of Self-Generated Counterfactual Explanations. CoRR Harry Mayne, Ryan Othniel Kearns, Yushi Yang, Andrew M. Bean, Eoin Delaney, Chris Russell, Adam Mahdi
2025	J	`jnl`	Measuring what Matters: Construct Validity in Large Language Model Benchmarks. CoRR Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jan Batzner, Negar Foroutan, Chris Schmitz, Karolina Korgul, Hunar Batra, Oishi Deb, Emma Beharry, Cornelius Emde, Thomas Foster, Anna Gausen, María Grandury, Simeng Han, Valentin Hofmann, Lujain Ibrahim, Hazel Kim, Hannah Rose Kirk, Fangru Lin, Gabrielle Kaili-May Liu, Lennart Luettgau, Jabez Magomere, Jonathan Rystrøm, Anna Sotnikova, Yushi Yang, Yilun Zhao, Adel Bibi, Antoine Bosselut, Ronald Clark, Arman Cohan, Jakob N. Foerster, Yarin Gal, Scott A. Hale, Inioluwa Deborah Raji, Christopher Summerfield, Philip H. S. Torr, Cozmin Ududec, Luc Rocher, Adam Mahdi
2025	J	`jnl`	Scales++: Compute Efficient Evaluation Subset Selection with Cognitive Scales Embeddings. CoRR Andrew M. Bean, Nabeel Seedat, Shengzhuang Chen, Jonathan Richard Schwarz
2024	J	`jnl`	Evaluating the role of 'Constitutions' for learning from AI feedback. CoRR Saskia Redgate, Andrew M. Bean, Adam Mahdi
2024	J	`jnl`	Fine-tuning Large Language Models with Human-inspired Learning Strategies in Medical Question Answering. CoRR Yushi Yang, Andrew M. Bean, Robert McCraith, Adam Mahdi
2024	—	`conf`	Indian-BhED: A Dataset for Measuring India-Centric Biases in Large Language Models. GoodIT Khyati Khandelwal, Manuel Tonneau, Andrew M. Bean, Hannah Rose Kirk, Scott A. Hale
2024	A*	`conf`	LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low Resource and Extinct Languages. NeurIPS Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan Chi, Ryan Chi, Scott Hale, Hannah Rose Kirk
2024	J	`jnl`	LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages. CoRR Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan A. Chi, Ryan Chi, Scott A. Hale, Hannah Rose Kirk
2024	A*	`conf`	The PRISM Alignment Dataset: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models. NeurIPS Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Rafael Mosquera Gómez, Juan Ciro, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott Hale
2024	J	`jnl`	The PRISM Alignment Project: What Participatory, Representative and Individualised Human Feedback Reveals About the Subjective and Multicultural Alignment of Large Language Models. CoRR Hannah Rose Kirk, Alexander Whitefield, Paul Röttger, Andrew M. Bean, Katerina Margatina, Juan Ciro, Rafael Mosquera, Max Bartolo, Adina Williams, He He, Bertie Vidgen, Scott A. Hale
2023	J	`jnl`	Casteist but Not Racist? Quantifying Disparities in Large Language Model Bias between India and the West. CoRR Khyati Khandelwal, Manuel Tonneau, Andrew M. Bean, Hannah Rose Kirk, Scott A. Hale
2023	J	`jnl`	Exploring the Landscape of Large Language Models In Medical Question Answering: Observations and Open Questions. CoRR Karolina Korgul, Andrew M. Bean, Felix Krones, Robert McCraith, Adam Mahdi
2023	A*	`conf`	The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values. EMNLP Hannah Kirk, Andrew M. Bean, Bertie Vidgen, Paul Röttger, Scott Hale
2023	J	`jnl`	The Past, Present and Better Future of Feedback Learning in Large Language Models for Subjective Human Preferences and Values. CoRR Hannah Rose Kirk, Andrew M. Bean, Bertie Vidgen, Paul Röttger, Scott A. Hale
2019	J	`jnl`	Regional data exchange to improve care for veterans after non-VA hospitalization: a randomized controlled trial. BMC Medical Informatics Decis. Mak. Brian E. Dixon, Ashley L. Schwartzkopf, Vivian M. Guerrero, Justine May, Nicholas S. Koufacos, Andrew M. Bean, Joan D. Penrod, Cathy C. Schubert, Kenneth S. Boockvar