Lorenzo Pacchiardi

21 papers A* 2Journal 17Unranked 1
YearRankTypeTitle / Venue / Authors
2026 J jnl
Capabilities Ain't All You Need: Measuring Propensities in AI.
CoRR
Daniel Romero-Alvarado, Fernando Martínez-Plumed, Lorenzo Pacchiardi, Hugo Save, Siddhesh Milind Pawar, Behzad Mehrbakhsh, Pablo Antonio Moreno Casares, Ben Slater, Paolo Bova, Peter Romero, Zachary R. Tidler, Jonathan E. Prunty, Luning Sun, José Hernández-Orallo
2026 J jnl
Frontier AI Auditing: Toward Rigorous Third-Party Assessment of Safety and Security Practices at Leading AI Companies.
CoRR
Miles Brundage, Noemi Dreksler, Aidan Homewood, Sean McGregor, Patricia Paskov, Conrad Stosz, Girish Sastry, A. Feder Cooper, George Balston, Steven Adler, Stephen Casper, Markus Anderljung, Grace W. Lindsay, Sören Mindermann, Vasilios Mavroudis, Ben Bucknall, Charlotte Stix, Jonas Freund, Lorenzo Pacchiardi, José Hernández-Orallo, Matteo Pistillo, Michael Chen, Chris Painter, Dean W. Ball, Cullen O'Keefe, Gabriel Weil, Ben Harack, Graeme Finley, Ryan Hassan, Scott Emmons, Charles Foster, Anka Reuel, Bri Treece, Yoshua Bengio, Daniel Reti, Rishi Bommasani, Cristian Trout, Ali Shahin Shamsabadi, Rajiv Dattani, Adrian Weller, Robert Trager, Jaime Sevilla, Lauren Wagner, Lisa Soder, Ketan Ramakrishnan, Henry Papadatos, Malcolm Murray, Ryan Tovcimak
2025 J jnl
General Scales Unlock AI Evaluation with Explanatory and Predictive Power.
CoRR
Lexin Zhou, Lorenzo Pacchiardi, Fernando Martínez-Plumed, Katherine M. Collins, Yael Moros-Daval, Seraphina Zhang, Qinlin Zhao, Yitian Huang, Luning Sun, Jonathan E. Prunty, Zongqian Li, Pablo Sánchez-García, Kexin Jiang Chen, Pablo A. M. Casares, Jiyun Zu, John Burden, Behzad Mehrbakhsh, David Stillwell, Manuel Cebrián, Jindong Wang, Peter Henderson, Sherry Tongshuang Wu, Patrick C. Kyllonen, Lucy Cheke, Xing Xie, José Hernández-Orallo
2025 J jnl
Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agents.
CoRR
Irene Testini, José Hernández-Orallo, Lorenzo Pacchiardi
2025 J jnl
Measuring Data Science Automation: A Survey of Evaluation Tools for AI Assistants and Agents.
Trans. Mach. Learn. Res.
Irene Testini, Lorenzo Pacchiardi, José Hernández-Orallo
2025 J jnl
No Answer Needed: Predicting LLM Answer Accuracy from Question-Only Linear Probes.
CoRR
Iván Vicente Moreno Cencerrado, Arnau Padrés Masdemont, Anton Gonzalvez Hawthorne, David Demitri Africa, Lorenzo Pacchiardi
2025 A* conf
Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture.
IJCAI
John Burden, Marko Tesic, Lorenzo Pacchiardi, José Hernández-Orallo
2025 J jnl
Paradigms of AI Evaluation: Mapping Goals, Methodologies and Culture.
CoRR
John Burden, Marko Tesic, Lorenzo Pacchiardi, José Hernández-Orallo
2025 — conf
PredictaBoard: Benchmarking LLM Score Predictability.
ACL (Findings)
Lorenzo Pacchiardi, Konstantinos Voudouris, Ben Slater, Fernando Martínez-Plumed, José Hernández-Orallo, Lexin Zhou, Wout Schellaert
2025 J jnl
PredictaBoard: Benchmarking LLM Score Predictability.
CoRR
Lorenzo Pacchiardi, Konstantinos Voudouris, Ben Slater, Fernando Martínez-Plumed, José Hernández-Orallo, Lexin Zhou, Wout Schellaert
2024 J jnl
100 instances is all you need: predicting the success of a new LLM on unseen data by testing on a few instances.
CoRR
Lorenzo Pacchiardi, Lucy G. Cheke, José Hernández-Orallo
2024 A* conf
How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions.
ICLR
Lorenzo Pacchiardi, Alex James Chan, Sören Mindermann, Ilan Moscovitz, Alexa Y. Pan, Yarin Gal, Owain Evans, Jan Markus Brauner
2024 J jnl
Leaving the barn door open for Clever Hans: Simple features predict LLM benchmark answers.
CoRR
Lorenzo Pacchiardi, Marko Tesic, Lucy G. Cheke, José Hernández-Orallo
2024 J jnl
Probabilistic Forecasting with Generative Networks via Scoring Rule Minimization.
J. Mach. Learn. Res.
Lorenzo Pacchiardi, Rilwan A. Adewoyin, Peter Dueben, Ritabrata Dutta
2023 J jnl
How to Catch an AI Liar: Lie Detection in Black-Box LLMs by Asking Unrelated Questions.
CoRR
Lorenzo Pacchiardi, Alex J. Chan, Sören Mindermann, Ilan Moscovitz, Alexa Y. Pan, Yarin Gal, Owain Evans, Jan Brauner
2022 J jnl
Likelihood-Free Inference with Generative Neural Networks via Scoring Rule Minimization.
CoRR
Lorenzo Pacchiardi, Ritabrata Dutta
2022 J jnl
Score Matched Neural Exponential Families for Likelihood-Free Inference.
J. Mach. Learn. Res.
Lorenzo Pacchiardi, Ritabrata Dutta
2022 — —
Statistical inference in generative models using scoring rules.
Lorenzo Pacchiardi
2021 J jnl
ABCpy: A High-Performance Computing Perspective to Approximate Bayesian Computation.
J. Stat. Softw.
Ritabrata Dutta, Marcel Schöngens, Lorenzo Pacchiardi, Avinash Ummadisingu, Nicole Widmer, Pierre Künzli, Jukka-Pekka Onnela, Antonietta Mira
2021 J jnl
Probabilistic Forecasting with Conditional Generative Networks via Scoring Rule Minimization.
CoRR
Lorenzo Pacchiardi, Rilwan Adewoyin, Peter Dueben, Ritabrata Dutta
2021 J jnl
Using mobility data in the design of optimal lockdown strategies for the COVID-19 pandemic.
PLoS Comput. Biol.
Ritabrata Dutta, Susana N. Gomes, Dante Kalise, Lorenzo Pacchiardi