Inioluwa Deborah Raji

54 papers A* 2A 1C 4Journal 33Unranked 14

Year	Rank	Type	Title / Venue / Authors
2025	J	`jnl`	Aggregated Individual Reporting for Post-Deployment Evaluation. CoRR Jessica Dai, Inioluwa Deborah Raji, Benjamin Recht, Irene Y. Chen
2025	J	`jnl`	Bridging Prediction and Intervention Problems in Social Systems. CoRR Lydia T. Liu, Inioluwa Deborah Raji, Angela Zhou, Luke Guerdan, Jessica Hullman, Daniel Malinsky, Bryan Wilder, Simone Zhang, Hammaad Adam, Amanda Coston, Benjamin Laufer, Ezinne Nwankwo, Michael Zanger-Tishler, Eli Ben-Michael, Solon Barocas, Avi Feller, Marissa Gerchick, Talia Gillis, Shion Guha, Daniel E. Ho, Lily Hu, Kosuke Imai, Sayash Kapoor, Joshua Loftus, Razieh Nabi, Arvind Narayanan, Ben Recht, Juan Carlos Perdomo, Matthew J. Salganik, Mark P. Sendak, Alexander Tolbert, Berk Ustun, Suresh Venkatasubramanian, Angelina Wang, Ashia Wilson
2025	A	`conf`	Evaluating Prediction-based Interventions with Human Decision Makers In Mind. AISTATS Inioluwa Deborah Raji, Lydia T. Liu
2025	J	`jnl`	Evaluating Prediction-based Interventions with Human Decision Makers In Mind. CoRR Inioluwa Deborah Raji, Lydia T. Liu
2025	A*	`conf`	From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms. ICML Jessica Dai, Paula Gradu, Inioluwa Deborah Raji, Benjamin Recht
2025	J	`jnl`	From Individual Experience to Collective Evidence: A Reporting-Based Framework for Identifying Systemic Harms. CoRR Jessica Dai, Paula Gradu, Inioluwa Deborah Raji, Benjamin Recht
2025	J	`jnl`	International AI Safety Report. CoRR Yoshua Bengio, Sören Mindermann, Daniel Privitera, Tamay Besiroglu, Rishi Bommasani, Stephen Casper, Yejin Choi, Philip Fox, Ben Garfinkel, Danielle Goldfarb, Hoda Heidari, Anson Ho, Sayash Kapoor, Leila Khalatbari, Shayne Longpre, Sam Manning, Vasilios Mavroudis, Mantas Mazeika, Julian Michael, Jessica Newman, Kwan Yee Ng, Chinasa T. Okolo, Inioluwa Deborah Raji, Girish Sastry, Elizabeth Seger, Theodora Skeadas, Tobin South, Emma Strubell, Florian Tramèr, Lucia Velasco, Nicole Wheeler, Daron Acemoglu, Olubayo Adekanmbi, David Dalrymple, Thomas G. Dietterich, Edward W. Felten, Pascale Fung, Pierre-Olivier Gourinchas, Fredrik Heintz, Geoffrey E. Hinton, Nick R. Jennings, Andreas Krause, Susan Leavy, Percy Liang, Teresa Ludermir, Vidushi Marda, Helen Margetts, John A. McDermid, Jane Munga, Arvind Narayanan, Alondra Nelson, Clara Neppel, Alice Oh, Gopal Ramchurn, Stuart Russell, Marietje Schaake, Bernhard Schölkopf, Dawn Song, Alvaro Soto, Lee Tiedrich, Gaël Varoquaux, Andrew Yao, Ya-Qin Zhang, Fahad Albalawi, Marwan Alserkal, Olubunmi Ajala, Guillaume Avrin, Christian Busch, André Carlos Ponce de Leon Ferreira de Carvalho, Bronwyn Fox, Amandeep Singh Gill, Ahmet Halit Hatip, Juha Heikkilä, Gill Jolly, Ziv Katzir, Hiroaki Kitano, Antonio Krüger, Chris Johnson, Saif M. Khan, Kyoung Mu Lee, Dominic Vincent Ligot, Oleksii Molchanovskyi, Andrea Monti, Nusu Mwamanzi, Mona Nemer, Nuria Oliver, José Ramón López Portillo, Balaraman Ravindran, Raquel Pezoa Rivera, Hammam Riza, Crystal Rugege, Ciarán Seoighe, Jerry Sheehan, Haroon Sheikh, Denise Wong, Yi Zeng
2025	J	`jnl`	Measuring what Matters: Construct Validity in Large Language Model Benchmarks. CoRR Andrew M. Bean, Ryan Othniel Kearns, Angelika Romanou, Franziska Sofia Hafner, Harry Mayne, Jan Batzner, Negar Foroutan, Chris Schmitz, Karolina Korgul, Hunar Batra, Oishi Deb, Emma Beharry, Cornelius Emde, Thomas Foster, Anna Gausen, María Grandury, Simeng Han, Valentin Hofmann, Lujain Ibrahim, Hazel Kim, Hannah Rose Kirk, Fangru Lin, Gabrielle Kaili-May Liu, Lennart Luettgau, Jabez Magomere, Jonathan Rystrøm, Anna Sotnikova, Yushi Yang, Yilun Zhao, Adel Bibi, Antoine Bosselut, Ronald Clark, Arman Cohan, Jakob N. Foerster, Yarin Gal, Scott A. Hale, Inioluwa Deborah Raji, Christopher Summerfield, Philip H. S. Torr, Cozmin Ududec, Luc Rocher, Adam Mahdi
2025	J	`jnl`	Medical Large Language Model Benchmarks Should Prioritize Construct Validity. CoRR Ahmed M. Alaa, Thomas Hartvigsen, Niloufar Golchini, Shiladitya Dutta, Frances Dean, Inioluwa Deborah Raji, Travis Zack
2025	J	`jnl`	Multi-lingual Functional Evaluation for Large Language Models. CoRR Victor Ojewale, Inioluwa Deborah Raji, Suresh Venkatasubramanian
2025	—	`conf`	Position: Medical Large Language Model Benchmarks Should Prioritize Construct Validity. ICML (Position Papers) Ahmed Alaa, Thomas Hartvigsen, Niloufar Golchini, Shiladitya Dutta, Frances Dean, Inioluwa Deborah Raji, Travis Zack
2025	J	`jnl`	The California Report on Frontier AI Policy. CoRR Rishi Bommasani, Scott R. Singer, Ruth E. Appel, Sarah H. Cen, A. Feder Cooper, Elena Cryst, Lindsey A. Gailmard, Ian Klaus, Meredith M. Lee, Inioluwa Deborah Raji, Anka Reuel, Drew Spence, Alexander Wan, Angelina Wang, Daniel Zhang, Daniel E. Ho, Percy Liang, Dawn Song, Joseph E. Gonzalez, Jonathan Zittrain, Jennifer Tour Chayes, Mariano-Florentino Cuellar, Li Fei-Fei
2025	J	`jnl`	Toward an Evaluation Science for Generative AI Systems. CoRR Laura Weidinger, Inioluwa Deborah Raji, Hanna M. Wallach, Margaret Mitchell, Angelina Wang, Olawale Salaudeen, Rishi Bommasani, Deep Ganguli, Sanmi Koyejo, William Isaac
2025	A*	`conf`	Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. CHI Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, Inioluwa Deborah Raji
2024	J	`jnl`	"I Searched for a Religious Song in Amharic and Got Sexual Content Instead": Investigating Online Harm in Low-Resourced Languages on YouTube. CoRR Hellina Hailu Nigatu, Inioluwa Deborah Raji
2024	—	`conf`	"I Searched for a Religious Song in Amharic and Got Sexual Content Instead'': Investigating Online Harm in Low-Resourced Languages on YouTube. FAccT Hellina Hailu Nigatu, Inioluwa Deborah Raji
2024	—	`conf`	AI auditing: The Broken Bus on the Road to AI Accountability. SaTML Abeba Birhane, Ryan Steed, Victor Ojewale, Briana Vecchione, Inioluwa Deborah Raji
2024	J	`jnl`	AI auditing: The Broken Bus on the Road to AI Accountability. CoRR Abeba Birhane, Ryan Steed, Victor Ojewale, Briana Vecchione, Inioluwa Deborah Raji
2024	J	`jnl`	Concrete Problems in AI Safety, Revisited. CoRR Inioluwa Deborah Raji, Roel Dobbe
2024	J	`jnl`	International Scientific Report on the Safety of Advanced AI (Interim Report). CoRR Yoshua Bengio, Sören Mindermann, Daniel Privitera, Tamay Besiroglu, Rishi Bommasani, Stephen Casper, Yejin Choi, Danielle Goldfarb, Hoda Heidari, Leila Khalatbari, Shayne Longpre, Vasilios Mavroudis, Mantas Mazeika, Kwan Yee Ng, Chinasa T. Okolo, Inioluwa Deborah Raji, Theodora Skeadas, Florian Tramèr, Bayo Adekanmbi, Paul F. Christiano, David Dalrymple, Thomas G. Dietterich, Edward W. Felten, Pascale Fung, Pierre-Olivier Gourinchas, Nick R. Jennings, Andreas Krause, Percy Liang, Teresa Ludermir, Vidushi Marda, Helen Margetts, John A. McDermid, Arvind Narayanan, Alondra Nelson, Alice Oh, Gopal Ramchurn, Stuart Russell, Marietje Schaake, Dawn Song, Alvaro Soto, Lee Tiedrich, Gaël Varoquaux, Andrew Yao, Ya-Qin Zhang
2024	—	`conf`	The Data Addition Dilemma. MLHC Judy Hanwen Shen, Inioluwa Deborah Raji, Irene Y. Chen
2024	J	`jnl`	The Data Addition Dilemma. CoRR Judy Hanwen Shen, Inioluwa Deborah Raji, Irene Y. Chen
2024	J	`jnl`	Towards AI Accountability Infrastructure: Gaps and Opportunities in AI Audit Tooling. CoRR Victor Ojewale, Ryan Steed, Briana Vecchione, Abeba Birhane, Inioluwa Deborah Raji
2023	—	`conf`	Accountability in Algorithmic Systems: From Principles to Practice. CHI Extended Abstracts Daricia Wilkinson, Kate Crawford, Hanna M. Wallach, Inioluwa Deborah Raji, Bogdana Rakova, Ranjit Singh, Angelika Strohmayer, Ethan Zuckerman
2023	J	`jnl`	Actionable Auditing Revisited: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. Commun. ACM Inioluwa Deborah Raji, Joy Buolamwini
2023	—	`conf`	Organizational Governance of Emerging Technologies: AI Adoption in Healthcare. FAccT Jee Young Kim, William Boag, Freya Gulamali, Alifia Hasan, Henry David Jeffry Hogg, Mark Lifson, Deirdre K. Mulligan, Manesh Patel, Inioluwa Deborah Raji, Ajai Sehgal, Keo Shaw, Danny Tobey, Alexandra Valladares, David E. Vidal, Suresh Balu, Mark P. Sendak
2023	J	`jnl`	Organizational Governance of Emerging Technologies: AI Adoption in Healthcare. CoRR Jee Young Kim, William Boag, Freya Gulamali, Alifia Hasan, Henry David Jeffry Hogg, Mark Lifson, Deirdre K. Mulligan, Manesh Patel, Inioluwa Deborah Raji, Ajai Sehgal, Keo Shaw, Danny Tobey, Alexandra Valladares, David E. Vidal, Suresh Balu, Mark P. Sendak
2023	J	`jnl`	REFORMS: Reporting Standards for Machine Learning Based Science. CoRR Sayash Kapoor, Emily Cantrell, Kenny Peng, Thanh Hien Pham, Christopher A. Bail, Odd Erik Gundersen, Jake M. Hofman, Jessica Hullman, Michael A. Lones, Momin M. Malik, Priyanka Nanayakkara, Russell A. Poldrack, Inioluwa Deborah Raji, Michael Roberts, Matthew J. Salganik, Marta Serra-Garcia, Brandon M. Stewart, Gilles Vandewiele, Arvind Narayanan
2023	J	`jnl`	Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem. CoRR Sasha Costanza-Chock, Emma Harvey, Inioluwa Deborah Raji, Martha Czernuszenko, Joy Buolamwini
2022	—	`conf`	Disentangling the Components of Ethical Research in Machine Learning. FAccT Carolyn Ashurst, Solon Barocas, Rosie Campbell, Inioluwa Deborah Raji
2022	C	`conf`	From Algorithmic Audits to Actual Accountability: Overcoming Practical Roadblocks on the Path to Meaningful Audit Interventions for AI Governance. AIES Inioluwa Deborah Raji
2022	C	`conf`	Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance. AIES Inioluwa Deborah Raji, Peggy Xu, Colleen Honigsberg, Daniel E. Ho
2022	J	`jnl`	Outsider Oversight: Designing a Third Party Audit Ecosystem for AI Governance. CoRR Inioluwa Deborah Raji, Peggy Xu, Colleen Honigsberg, Daniel E. Ho
2022	—	`conf`	The Fallacy of AI Functionality. FAccT Inioluwa Deborah Raji, I. Elizabeth Kumar, Aaron Horowitz, Andrew D. Selbst
2022	J	`jnl`	The Fallacy of AI Functionality. CoRR Inioluwa Deborah Raji, I. Elizabeth Kumar, Aaron Horowitz, Andrew D. Selbst
2022	—	`conf`	Who Audits the Auditors? Recommendations from a field scan of the algorithmic auditing ecosystem. FAccT Sasha Costanza-Chock, Inioluwa Deborah Raji, Joy Buolamwini
2021	—	`conf`	AI and the Everything in the Whole Wide World Benchmark. NeurIPS Datasets and Benchmarks Inioluwa Deborah Raji, Emily Denton, Emily M. Bender, Alex Hanna, Amandalynne Paullada
2021	J	`jnl`	AI and the Everything in the Whole Wide World Benchmark. CoRR Inioluwa Deborah Raji, Emily M. Bender, Amandalynne Paullada, Emily Denton, Alex Hanna
2021	J	`jnl`	About Face: A Survey of Facial Recognition Evaluation. CoRR Inioluwa Deborah Raji, Genevieve Fried
2021	—	`conf`	Are We Learning Yet? A Meta Review of Evaluation Failures Across Machine Learning. NeurIPS Datasets and Benchmarks Thomas Liao, Rohan Taori, Inioluwa Deborah Raji, Ludwig Schmidt
2021	J	`jnl`	Data and its (dis)contents: A survey of dataset development and use in machine learning research. Patterns Amandalynne Paullada, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, Alex Hanna
2021	—	`conf`	You Can't Sit With Us: Exclusionary Pedagogy in AI Ethics Education. FAccT Inioluwa Deborah Raji, Morgan Klaus Scheuerman, Razvan Amironesei
2020	J	`jnl`	Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditing. CoRR Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, Parker Barnes
2020	—	`conf`	Closing the AI accountability gap: defining an end-to-end framework for internal algorithmic auditing. FAT* Inioluwa Deborah Raji, Andrew Smart, Rebecca N. White, Margaret Mitchell, Timnit Gebru, Ben Hutchinson, Jamila Smith-Loud, Daniel Theron, Parker Barnes
2020	J	`jnl`	Data and its (dis)contents: A survey of dataset development and use in machine learning research. CoRR Amandalynne Paullada, Inioluwa Deborah Raji, Emily M. Bender, Emily Denton, Alex Hanna
2020	J	`jnl`	Handle with Care: Lessons for Data Science from Black Female Scholars. Patterns Inioluwa Deborah Raji
2020	C	`conf`	Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. AIES Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell, Joy Buolamwini, Joonseok Lee, Emily Denton
2020	J	`jnl`	Saving Face: Investigating the Ethical Concerns of Facial Recognition Auditing. CoRR Inioluwa Deborah Raji, Timnit Gebru, Margaret Mitchell, Joy Buolamwini, Joonseok Lee, Emily Denton
2020	J	`jnl`	The Discomfort of Death Counts: Mourning through the Distorted Lens of Reported COVID-19 Death Data. Patterns Inioluwa Deborah Raji
2019	J	`jnl`	ABOUT ML: Annotation and Benchmarking on Understanding and Transparency of Machine Learning Lifecycles. CoRR Inioluwa Deborah Raji, Jingying Yang
2019	C	`conf`	Actionable Auditing: Investigating the Impact of Publicly Naming Biased Performance Results of Commercial AI Products. AIES Inioluwa Deborah Raji, Joy Buolamwini
2019	—	`conf`	Model Cards for Model Reporting. FAT Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru
2019	J	`jnl`	On the Legal Compatibility of Fairness Definitions. CoRR Alice Xiang, Inioluwa Deborah Raji
2018	J	`jnl`	Model Cards for Model Reporting. CoRR Margaret Mitchell, Simone Wu, Andrew Zaldivar, Parker Barnes, Lucy Vasserman, Ben Hutchinson, Elena Spitzer, Inioluwa Deborah Raji, Timnit Gebru