Kenneth Holstein

126 papers A* 21A 7B 8Journal 58Unranked 32
YearRankTypeTitle / Venue / Authors
2026 A* conf
Botender: Supporting Communities in Collaboratively Designing AI Agents through Case-Based Provocations.
CHI
Tzu-Sheng Kuo, Sophia Liu, Quan Ze Chen, Joseph Seering, Amy X. Zhang, Haiyi Zhu, Kenneth Holstein
2026 J jnl
ComplLLM: Fine-tuning LLMs to Discover Complementary Signals for Decision-making.
CoRR
Ziyang Guo, Yifan Wu, Jason D. Hartline, Kenneth Holstein, Jessica Hullman
2026 A* conf
Funding AI for Good: A Call for Meaningful Engagement.
CHI
Hongjin Lin, Anna Kawakami, Catherine D'Ignazio, Kenneth Holstein, Krzysztof Z. Gajos
2026 — conf
Human-Centered Explainable AI (HCXAI): Re-examining XAI in the Era of Agentic AI.
CHI Extended Abstracts
Upol Ehsan, Amal Alabdulkarim, Kenneth Holstein, Min Kyung Lee, Andreas Riener, Justin D. Weisz
2026 A* conf
PolicyPad: Collaborative Prototyping of LLM Policies.
CHI
K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Jim Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang
2026 A* conf
Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Oz.
CHI
Frederic Gmeiner, Kenneth Holstein, Nikolas Martelaro
2026 — conf
Tools for Thought: Understanding, Protecting, and Augmenting Human Cognition with Generative AI - From Vision to Implementation.
CHI Extended Abstracts
Zelun Tony Zhang, Nick von Felten, Leon Reicherts, Lev Tankelevitch, Zhitong Guan, Sean Rintel, Yue Fu, Jessica He, Kenneth Holstein, Advait Sarkar, Gonzalo A. Ramos, Anuschka Schmitt, Anjali Singh, Haotian Li, Srishti Palani, Peter Dalsgaard
2026 J jnl
Toward Third-Party Assurance of AI Systems: Design Requirements, Prototype, and Early Testing.
CoRR
Rachel M. Kim, Blaine Kuehnert, Alice Lai, Kenneth Holstein, Hoda Heidari, Rayid Ghani
2025 J jnl
AI Failure Loops in Devalued Work: The Confluence of Overconfidence in AI and Underconfidence in Worker Expertise.
CoRR
Anna Kawakami, Jordan Taylor, Sarah E. Fox, Haiyi Zhu, Kenneth Holstein
2025 A* conf
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development.
CHI
Devansh Saxena, Ji-Youn Jung, Jodi Forlizzi, Kenneth Holstein, John Zimmerman
2025 J jnl
AI Mismatches: Identifying Potential Algorithmic Harms Before AI Development.
CoRR
Devansh Saxena, Ji-Youn Jung, Jodi Forlizzi, Kenneth Holstein, John Zimmerman
2025 J jnl
Botender: Supporting Communities in Collaboratively Designing AI Agents through Case-Based Provocations.
CoRR
Tzu-Sheng Kuo, Sophia Liu, Quan Ze Chen, Joseph Seering, Amy X. Zhang, Haiyi Zhu, Kenneth Holstein
2025 — conf
Collective Meaning Cascades but Strange Ducks Swim Upstream: Facilitating Collective Meaning-making through Co-development of AI Models.
CHI Extended Abstracts
Aaron Lee Halfaker, Tzu-Sheng Kuo, Ciell Brusse, Kenneth Holstein, Haiyi Zhu
2025 J jnl
Doubly-Robust LLM-as-a-Judge: Externally Valid Estimation with Imperfect Personas.
CoRR
Luke Guerdan, Justin Whitehouse, Kimberly Le Truong, Kenneth Holstein, Zhiwei Steven Wu
2025 A conf
Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creation.
Conference on Designing Interactive Systems
Frederic Gmeiner, Kaitao Luo, Ye Wang, Kenneth Holstein, Nikolas Martelaro
2025 J jnl
Exploring the Potential of Metacognitive Support Agents for Human-AI Co-Creation.
CoRR
Frederic Gmeiner, Kaitao Luo, Ye Wang, Kenneth Holstein, Nikolas Martelaro
2025 J jnl
Funding AI for Good: A Call for Meaningful Engagement.
CoRR
Hongjin Lin, Anna Kawakami, Catherine D'Ignazio, Kenneth Holstein, Krzysztof Gajos
2025 A* conf
Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows.
CHI
Frederic Gmeiner, Nicolai Marquardt, Michael Bentley, Hugo Romat, Michel Pahud, David Brown, Asta Roseway, Nikolas Martelaro, Kenneth Holstein, Ken Hinckley, Nathalie Riche
2025 J jnl
Intent Tagging: Exploring Micro-Prompting Interactions for Supporting Granular Human-GenAI Co-Creation Workflows.
CoRR
Frederic Gmeiner, Nicolai Marquardt, Michael Bentley, Hugo Romat, Michel Pahud, David Brown, Asta Roseway, Nikolas Martelaro, Kenneth Holstein, Ken Hinckley, Nathalie Riche
2025 J jnl
Making the Right Thing: Bridging HCI and Responsible AI in Early-Stage AI Concept Selection.
CoRR
Ji-Youn Jung, Devansh Saxena, Minjung Park, Jini Kim, Jodi Forlizzi, Kenneth Holstein, John Zimmerman
2025 J jnl
Measurement as Bricolage: Examining How Data Scientists Construct Target Variables for Predictive Modeling Tasks.
CoRR
Luke Guerdan, Devansh Saxena, Stevie Chancellor, Zhiwei Steven Wu, Kenneth Holstein
2025 J jnl
Measurement as Bricolage: Examining How Data Scientists Construct Target Variables for Predictive Modeling Tasks.
Proc. ACM Hum. Comput. Interact.
Luke Guerdan, Devansh Saxena, Stevie Chancellor, Zhiwei Steven Wu, Kenneth Holstein
2025 A* conf
Policy Maps: Tools for Guiding the Unbounded Space of LLM Behaviors.
UIST
Michelle S. Lam, Fred Hohman, Dominik Moritz, Jeffrey P. Bigham, Kenneth Holstein, Mary Beth Kery
2025 A* conf
PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation.
CHI
Tzu-Sheng Kuo, Quan Ze Chen, Amy X. Zhang, Jane Hsieh, Haiyi Zhu, Kenneth Holstein
2025 J jnl
PolicyPad: Collaborative Prototyping of LLM Policies.
CoRR
K. J. Kevin Feng, Tzu-Sheng Kuo, Quan Ze Chen, Inyoung Cheong, Kenneth Holstein, Amy X. Zhang
2025 J jnl
Prototyping Multimodal GenAI Real-Time Agents with Counterfactual Replays and Hybrid Wizard-of-Oz.
CoRR
Frederic Gmeiner, Kenneth Holstein, Nikolas Martelaro
2025 J jnl
Seeing Twice: How Side-by-Side T2I Comparison Changes Auditing Strategies.
CoRR
Matheus Kunzler Maldaner, Wesley Hanwen Deng, Jason I. Hong, Kenneth Holstein, Motahhare Eslami
2025 J jnl
Supporting AI-Augmented Meta-Decision Making with InDecision.
CoRR
Chance Castañeda, Jessica Mindel, Will Page, Hayden Stec, Manqing Yu, Kenneth Holstein
2025 J jnl
Validating LLM-as-a-Judge Systems in the Absence of Gold Labels.
CoRR
Luke Guerdan, Solon Barocas, Kenneth Holstein, Hanna M. Wallach, Zhiwei Steven Wu, Alexandra Chouldechova
2025 J jnl
WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AI.
CoRR
Wesley Hanwen Deng, Wang Claire, Howard Ziyu Han, Jason I. Hong, Kenneth Holstein, Motahhare Eslami
2025 J jnl
WeAudit: Scaffolding User Auditors and AI Practitioners in Auditing Generative AI.
Proc. ACM Hum. Comput. Interact.
Wesley Hanwen Deng, Wang Claire, Howard Ziyu Han, Jason I. Hong, Kenneth Holstein, Motahhare Eslami
2024 — conf
AI Failure Cards: Understanding and Supporting Grassroots Efforts to Mitigate AI Failures in Homeless Services.
FAccT
Ningjing Tang, Jiayin Zhi, Tzu-Sheng Kuo, Calla Kainaroi, Jeremy J. Northup, Kenneth Holstein, Haiyi Zhu, Hoda Heidari, Hong Shen
2024 J jnl
AI Policy Projector: Grounding LLM Policy Design in Iterative Mapmaking.
CoRR
Michelle S. Lam, Fred Hohman, Dominik Moritz, Jeffrey P. Bigham, Kenneth Holstein, Mary Beth Kery
2024 — conf
An Evidence-based Workflow for Studying and Designing Learning Supports for Human-AI Co-creation.
CHI Extended Abstracts
Frederic Gmeiner, Jamie Lynn Conlin, Eric Handa Tang, Nikolas Martelaro, Kenneth Holstein
2024 — conf
Building, Shifting, & Employing Power: A Taxonomy of Responses From Below to Algorithmic Harm.
FAccT
Alicia DeVrio, Motahhare Eslami, Kenneth Holstein
2024 J jnl
Carefully Unmaking the "Marginalized User": A Diffractive Analysis of a Gay Online Community.
ACM Trans. Comput. Hum. Interact.
Jordan Taylor, Wesley Hanwen Deng, Kenneth Holstein, Sarah E. Fox, Haiyi Zhu
2024 — conf
Collaboratively Designing and Evaluating Responsible AI Interventions.
CSCW Companion
Wesley Hanwen Deng, Glen Berman, Harmanpreet Kaur, Reva Schwartz, Memunat Ajoke Ibrahim, Motahhare Eslami, Kenneth Holstein, Michael Madaio
2024 J jnl
Don't be Fooled: The Misinformation Effect of Explanations in Human-AI Collaboration.
CoRR
Philipp Spitzer, Joshua Holstein, Katelyn Morrison, Kenneth Holstein, Gerhard Satzger, Niklas Kühl
2024 J jnl
PolicyCraft: Supporting Collaborative and Participatory Policy Design through Case-Grounded Deliberation.
CoRR
Tzu-Sheng Kuo, Quan Ze Chen, Amy X. Zhang, Jane Hsieh, Haiyi Zhu, Kenneth Holstein
2024 — conf
Practicing Inclusivity in AI: Stakeholder Engagement Policy in Action.
CSCW Companion
Tina M. Park, Adriana Alvarado Garcia, Juana Catalina Becerra Sandoval, Jiyoo Chang, Bill Curtis-Davidson, Remi Denton, Seeta Peña Gangadharan, Lara Groves, Jerremy Holland, Kenneth Holstein, Tamara Kneese, Jacob Metcalf, Emanuel Moss, Wilneida Negrón, Afsaneh Rigot, Lauren Wilcox
2024 J jnl
Predictive Performance Comparison of Decision Policies Under Confounding.
CoRR
Luke Guerdan, Amanda Coston, Kenneth Holstein, Zhiwei Steven Wu
2024 J jnl
Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Use.
CoRR
Anna Kawakami, Amanda Coston, Hoda Heidari, Kenneth Holstein, Haiyi Zhu
2024 J jnl
Studying Up Public Sector AI: How Networks of Power Relations Shape Agency Decisions Around AI Design and Use.
Proc. ACM Hum. Comput. Interact.
Anna Kawakami, Amanda Coston, Hoda Heidari, Kenneth Holstein, Haiyi Zhu
2024 J jnl
The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder Early-stage Deliberations Around Public Sector AI Proposals.
CoRR
Anna Kawakami, Amanda Coston, Haiyi Zhu, Hoda Heidari, Kenneth Holstein
2024 A* conf
The Situate AI Guidebook: Co-Designing a Toolkit to Support Multi-Stakeholder, Early-stage Deliberations Around Public Sector AI Proposals.
CHI
Anna Kawakami, Amanda Coston, Haiyi Zhu, Hoda Heidari, Kenneth Holstein
2024 — conf
Trust and Reliance in Evolving Human-AI Workflows (TREW).
CHI Extended Abstracts
Zahra Ashktorab, Gagan Bansal, Zana Buçinca, Kenneth Holstein, Jessica Hullman, Alison Marie Smith-Renner, Tongshuang Wu, Wenjuan Zhang
2024 A* conf
Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia.
CHI
Tzu-Sheng Kuo, Aaron Lee Halfaker, Zirui Cheng, JiWoo Kim, Meng-Hsin Wu, Tongshuang Wu, Kenneth Holstein, Haiyi Zhu
2024 J jnl
Wikibench: Community-Driven Data Curation for AI Evaluation on Wikipedia.
CoRR
Tzu-Sheng Kuo, Aaron Halfaker, Zirui Cheng, JiWoo Kim, Meng-Hsin Wu, Tongshuang Wu, Kenneth Holstein, Haiyi Zhu
2023 — conf
AI Literacy: Finding Common Threads between Education, Design, Policy, and Explainability.
CHI Extended Abstracts
Duri Long, Jessica Roberts, Brian Magerko, Kenneth Holstein, Daniella DiPaola, Fred Martin
2023 — conf
Community-driven AI: Empowering people through responsible data-driven decision-making.
CSCW Companion
Ruyuan Wan, Adriana Alvarado Garcia, Devansh Saxena, Catalina Vajiac, Anna Kawakami, Logan Stapleton, Haiyi Zhu, Kenneth Holstein, Heloisa Candello, Karla A. Badillo-Urquiola
2023 — conf
Counterfactual Prediction Under Outcome Measurement Error.
FAccT
Luke Guerdan, Amanda Coston, Kenneth Holstein, Zhiwei Steven Wu
2023 J jnl
Counterfactual Prediction Under Outcome Measurement Error.
CoRR
Luke Guerdan, Amanda Coston, Kenneth Holstein, Zhiwei Steven Wu
2023 J jnl
Evaluating the Impact of Human Explanation Strategies on Human-AI Visual Decision-Making.
Proc. ACM Hum. Comput. Interact.
Katelyn Morrison, Donghoon Shin, Kenneth Holstein, Adam Perer
2023 A* conf
Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools.
CHI
Frederic Gmeiner, Humphrey Yang, Lining Yao, Kenneth Holstein, Nikolas Martelaro
2023 J jnl
Exploring Challenges and Opportunities to Support Designers in Learning to Co-create with AI-based Manufacturing Design Tools.
CoRR
Frederic Gmeiner, Humphrey Yang, Lining Yao, Kenneth Holstein, Nikolas Martelaro
2023 — conf
Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making.
FAccT
Luke Guerdan, Amanda Coston, Zhiwei Steven Wu, Kenneth Holstein
2023 J jnl
Ground(less) Truth: A Causal Framework for Proxy Labels in Human-Algorithm Decision-Making.
CoRR
Luke Guerdan, Amanda Coston, Zhiwei Steven Wu, Kenneth Holstein
2023 — conf
Investigating Practices and Opportunities for Cross-functional Collaboration around AI Fairness in Industry Practice.
FAccT
Wesley Hanwen Deng, Nur Yildirim, Monica Chang, Motahhare Eslami, Kenneth Holstein, Michael Madaio
2023 — conf
LLMs and the Infrastructure of CSCW.
CSCW Companion
Chinmay Kulkarni, Tongshuang Wu, Kenneth Holstein, Q. Vera Liao, Min Kyung Lee, Mina Lee, Hariharan Subramonyam
2023 A* conf
Pair-Up: Prototyping Human-AI Co-orchestration of Dynamic Transitions between Individual and Collaborative Learning in the Classroom.
CHI
Kexin Bella Yang, Vanessa Echeverría, Zijing Lu, Hongyu Mao, Kenneth Holstein, Nikol Rummel, Vincent Aleven
2023 J jnl
Recentering Validity Considerations through Early-Stage Deliberations Around AI and Policy Design.
CoRR
Anna Kawakami, Amanda Coston, Haiyi Zhu, Hoda Heidari, Kenneth Holstein
2023 — conf
Supporting User Engagement in Testing, Auditing, and Contesting AI.
CSCW Companion
Wesley Hanwen Deng, Michelle S. Lam, Ángel Alexander Cabrera, Danaë Metaxa, Motahhare Eslami, Kenneth Holstein
2023 J jnl
Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables.
Proc. ACM Hum. Comput. Interact.
Kenneth Holstein, Maria De-Arteaga, Lakshmi Tumati, Yanghuidi Cheng
2023 J jnl
Towards "Anytime, Anywhere" Community Learning and Engagement around the Design of Public Sector AI.
CoRR
Wesley Hanwen Deng, Motahhare Eslami, Kenneth Holstein
2023 — conf
Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge.
CI
Anna Kawakami, Luke Guerdan, Yanghuidi Cheng, Kate Glazko, Matthew L. Lee, Scott A. Carter, Nikos Aréchiga, Haiyi Zhu, Kenneth Holstein
2023 J jnl
Training Towards Critical Use: Learning to Situate AI Predictions Relative to Human Knowledge.
CoRR
Anna Kawakami, Luke Guerdan, Yanghuidi Cheng, Matthew L. Lee, Scott A. Carter, Nikos Aréchiga, Kate Glazko, Haiyi Zhu, Kenneth Holstein
2023 A* conf
Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services.
CHI
Tzu-Sheng Kuo, Hong Shen, Jisoo Geum, Nev Jones, Jason I. Hong, Haiyi Zhu, Kenneth Holstein
2023 J jnl
Understanding Frontline Workers' and Unhoused Individuals' Perspectives on AI Used in Homeless Services.
CoRR
Tzu-Sheng Kuo, Hong Shen, Jisoo Geum, Nev Jones, Jason I. Hong, Haiyi Zhu, Kenneth Holstein
2023 A* conf
Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice.
CHI
Wesley Hanwen Deng, Bill Boyuan Guo, Alicia DeVrio, Hong Shen, Motahhare Eslami, Kenneth Holstein
2023 — conf
Workshop on Trust and Reliance in AI-Human Teams (TRAIT).
CHI Extended Abstracts
Gagan Bansal, Zana Buçinca, Kenneth Holstein, Jessica Hullman, Alison Marie Smith-Renner, Simone Stumpf, Sherry Wu
2023 A* conf
Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning.
CHI
Ángel Alexander Cabrera, Erica Fu, Donald Bertucci, Kenneth Holstein, Ameet Talwalkar, Jason I. Hong, Adam Perer
2023 J jnl
Zeno: An Interactive Framework for Behavioral Evaluation of Machine Learning.
CoRR
Ángel Alexander Cabrera, Erica Fu, Donald Bertucci, Kenneth Holstein, Ameet Talwalkar, Jason I. Hong, Adam Perer
2022 A* conf
"A Second Voice": Investigating Opportunities and Challenges for Interactive Voice Assistants to Support Home Health Aides.
CHI
Vince Bartle, Janice Lyu, Freesoul El Shabazz-Thompson, Yunmin Oh, Angela Anqi Chen, Yu-Jan Chang, Kenneth Holstein, Nicola Dell
2022 A conf
"Why Do I Care What's Similar?" Probing Challenges in AI-Assisted Child Welfare Decision-Making through Worker-AI Interface Design Concepts.
Conference on Designing Interactive Systems
Anna Kawakami, Venkatesh Sivaraman, Logan Stapleton, Hao Fei Cheng, Adam Perer, Zhiwei Steven Wu, Haiyi Zhu, Kenneth Holstein
2022 J jnl
A Unifying Framework for Combining Complementary Strengths of Humans and ML toward Better Predictive Decision-Making.
CoRR
Charvi Rastogi, Liu Leqi, Kenneth Holstein, Hoda Heidari
2022 J jnl
Designing for Human-AI Complementarity in K-12 Education.
AI Mag.
Kenneth Holstein, Vincent Aleven
2022 — conf
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits.
FAccT
Wesley Hanwen Deng, Manish Nagireddy, Michelle Seng Ah Lee, Jatinder Singh, Zhiwei Steven Wu, Kenneth Holstein, Haiyi Zhu
2022 J jnl
Exploring How Machine Learning Practitioners (Try To) Use Fairness Toolkits.
CoRR
Wesley Hanwen Deng, Manish Nagireddy, Michelle Seng Ah Lee, Jatinder Singh, Zhiwei Steven Wu, Kenneth Holstein, Haiyi Zhu
2022 J jnl
Extended Analysis of "How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions".
CoRR
Logan Stapleton, Hao Fei Cheng, Anna Kawakami, Venkatesh Sivaraman, Yanghuidi Cheng, Diana Qing, Adam Perer, Kenneth Holstein, Zhiwei Steven Wu, Haiyi Zhu
2022 A* conf
How Child Welfare Workers Reduce Racial Disparities in Algorithmic Decisions.
CHI
Hao Fei Cheng, Logan Stapleton, Anna Kawakami, Venkatesh Sivaraman, Yanghuidi Cheng, Diana Qing, Adam Perer, Kenneth Holstein, Zhiwei Steven Wu, Haiyi Zhu
2022 J jnl
Imagining new futures beyond predictive systems in child welfare: A qualitative study with impacted stakeholders.
CoRR
Logan Stapleton, Min Hun Lee, Diana Qing, Marya Wright, Alexandra Chouldechova, Kenneth Holstein, Zhiwei Steven Wu, Haiyi Zhu
2022 A* conf
Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Support.
CHI
Anna Kawakami, Venkatesh Sivaraman, Hao Fei Cheng, Logan Stapleton, Yanghuidi Cheng, Diana Qing, Adam Perer, Zhiwei Steven Wu, Haiyi Zhu, Kenneth Holstein
2022 J jnl
Improving Human-AI Partnerships in Child Welfare: Understanding Worker Practices, Challenges, and Desires for Algorithmic Decision Support.
CoRR
Anna Kawakami, Venkatesh Sivaraman, Hao Fei Cheng, Logan Stapleton, Yanghuidi Cheng, Diana Qing, Adam Perer, Zhiwei Steven Wu, Haiyi Zhu, Kenneth Holstein
2022 J jnl
Part of the Conversation: Workforce Professionals' Perspectives on the Roles and Impacts of Workforce Technologies.
Proc. ACM Hum. Comput. Interact.
Connie W. Chau, Kenneth Holstein, Michael Madaio
2022 J jnl
Team Learning as a Lens for Designing Human-AI Co-Creative Systems.
CoRR
Frederic Gmeiner, Kenneth Holstein, Nikolas Martelaro
2022 J jnl
Toward Supporting Perceptual Complementarity in Human-AI Collaboration via Reflection on Unobservables.
CoRR
Kenneth Holstein, Maria De-Arteaga, Lakshmi Tumati, Yanghuidi Cheng
2022 A* conf
Toward User-Driven Algorithm Auditing: Investigating users' strategies for uncovering harmful algorithmic behavior.
CHI
Alicia DeVos, Aditi Dhabalia, Hong Shen, Kenneth Holstein, Motahhare Eslami
2022 J jnl
Towards a Learner-Centered Explainable AI: Lessons from the learning sciences.
CoRR
Anna Kawakami, Luke Guerdan, Yang Cheng, Anita Sun, Alison Hu, Kate Glazko, Nikos Aréchiga, Matthew L. Lee, Scott A. Carter, Haiyi Zhu, Kenneth Holstein
2022 J jnl
Understanding Practices, Challenges, and Opportunities for User-Driven Algorithm Auditing in Industry Practice.
CoRR
Wesley Hanwen Deng, Bill Boyuan Guo, Alicia DeVrio, Hong Shen, Motahhare Eslami, Kenneth Holstein
2022 — conf
Who Has an Interest in "Public Interest Technology"?: Critical Questions for Working with Local Governments & Impacted Communities.
CSCW Companion
Logan Stapleton, Devansh Saxena, Anna Kawakami, Tonya Nguyen, Asbjørn Ammitzbøll Flügge, Motahhare Eslami, Naja L. Holten Møller, Min Kyung Lee, Shion Guha, Kenneth Holstein, Haiyi Zhu
2022 — conf
Workshop on Trust and Reliance in AI-Human Teams (TRAIT).
CHI Extended Abstracts
Gagan Bansal, Alison Marie Smith-Renner, Zana Buçinca, Tongshuang Wu, Kenneth Holstein, Jessica Hullman, Simone Stumpf
2021 J jnl
Can Crowds Customize Instructional Materials with Minimal Expert Guidance?: Exploring Teacher-guided Crowdsourcing for Improving Hints in an AI-based Tutor.
Proc. ACM Hum. Comput. Interact.
Kexin Bella Yang, Tomohiro Nagashima, Junhui Yao, Joseph Jay Williams, Kenneth Holstein, Vincent Aleven
2021 J jnl
Characterizing Human Explanation Strategies to Inform the Design of Explainable AI for Building Damage Assessment.
CoRR
Donghoon Shin, Sachin Grover, Kenneth Holstein, Adam Perer
2021 J jnl
Designing for human-AI complementarity in K-12 education.
CoRR
Kenneth Holstein, Vincent Aleven
2021 J jnl
Equity and Artificial Intelligence in Education: Will "AIEd" Amplify or Alleviate Inequities in Education?
CoRR
Kenneth Holstein, Shayan Doroudi
2021 J jnl
Everyday Algorithm Auditing: Understanding the Power of Everyday Users in Surfacing Harmful Algorithmic Behaviors.
Proc. ACM Hum. Comput. Interact.
Hong Shen, Alicia DeVos, Motahhare Eslami, Kenneth Holstein
2021 J jnl
Everyday algorithm auditing: Understanding the power of everyday users in surfacing harmful algorithmic behaviors.
CoRR
Hong Shen, Alicia DeVos, Motahhare Eslami, Kenneth Holstein
2021 B conf
SimPairing - Exploring Dynamic Pairing Policies through Historical Data Simulation and User-centered Research.
EDM
Kexin Bella Yang, Xuejian Wang, Vanessa Echeverría, LuEttaMae Lawrence, Kenneth Holstein, Nikol Rummel, Vincent Aleven
2021 B conf
Teachers' Orchestration Needs During the Shift to Remote Learning.
EC-TEL
LuEttaMae Lawrence, Kenneth Holstein, Susan R. Berman, Stephen Fancsali, Bruce M. McLaren, Steven Ritter, Vincent Aleven
2020 — conf
A Conceptual Framework for Human-AI Hybrid Adaptivity in Education.
AIED (1)
Kenneth Holstein, Vincent Aleven, Nikol Rummel
2020 B conf
Exploring Human-AI Control Over Dynamic Transitions Between Individual and Collaborative Learning.
EC-TEL
Vanessa Echeverría, Kenneth Holstein, Jennifer Huang, Jonathan Sewall, Nikol Rummel, Vincent Aleven
2020 — conf
Probing Learning Scientists' Beliefs About Learning and Science.
ICLS
Shayan Doroudi, Kenneth Holstein, Petr Johanes
2020 A conf
Replay Enactments: Exploring Possible Futures through Historical Data.
Conference on Designing Interactive Systems
Kenneth Holstein, Erik Harpstead, Rebecca Gulotta, Jodi Forlizzi
2020 A* conf
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms.
CHI
Pengcheng An, Kenneth Holstein, Bernice d'Anjou, Berry Eggen, Saskia Bakker
2020 J jnl
The TA Framework: Designing Real-time Teaching Augmentation for K-12 Classrooms.
CoRR
Pengcheng An, Kenneth Holstein, Bernice d'Anjou, Berry Eggen, Saskia Bakker
2020 — conf
Towards Practical Detection of Unproductive Struggle.
AIED (2)
Stephen E. Fancsali, Kenneth Holstein, Michael Sandbothe, Steven Ritter, Bruce M. McLaren, Vincent Aleven
2019 J jnl
Co-Designing a Real-Time Classroom Orchestration Tool to Support Teacher-AI Complementarity.
J. Learn. Anal.
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2019 — conf
Designing for Complementarity: Teacher and Student Needs for Orchestration Support in AI-Enhanced Classrooms.
AIED (1)
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2019 B conf
Early Detection of Wheel Spinning: Comparison across Tutors, Models, Features, and Operationalizations.
EDM
Chuankai Zhang, Yanzun Huang, Jingyu Wang, Dongyang Lu, Weiqi Fang, John C. Stamper, Stephen Fancsali, Kenneth Holstein, Vincent Aleven
2019 A* conf
Improving Fairness in Machine Learning Systems: What Do Industry Practitioners Need?
CHI
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miroslav Dudík, Hanna M. Wallach
2018 J jnl
Improving fairness in machine learning systems: What do industry practitioners need?
CoRR
Kenneth Holstein, Jennifer Wortman Vaughan, Hal Daumé III, Miroslav Dudík, Hanna M. Wallach
2018 — conf
Informing the Design of Teacher Awareness Tools through Causal Alignment Analysis.
ICLS
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2018 — conf
Opening Up an Intelligent Tutoring System Development Environment for Extensible Student Modeling.
AIED (1)
Kenneth Holstein, Zac Yu, Jonathan Sewall, Octav Popescu, Bruce M. McLaren, Vincent Aleven
2018 — conf
Orchestration tools for teachers in the context of individual and collaborative learning: what information do teachers need and what do they do with it?
ICLS
Anouschka van Leeuwen, Nikol Rummel, Kenneth Holstein, Bruce M. McLaren, Vincent Aleven, Inge Molenaar, Carolien Knoop van Campen, Baruch B. Schwarz, Naomi Prusak, Osama Swidan, Avi Segal, Kobi Gal
2018 — conf
Student Learning Benefits of a Mixed-Reality Teacher Awareness Tool in AI-Enhanced Classrooms.
AIED (1)
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2018 A conf
The classroom as a dashboard: co-designing wearable cognitive augmentation for K-12 teachers.
LAK
Kenneth Holstein, Gena Hong, Mera Tegene, Bruce M. McLaren, Vincent Aleven
2018 A conf
What exactly do students learn when they practice equation solving?: refining knowledge components with the additive factors model.
LAK
Yanjin Long, Kenneth Holstein, Vincent Aleven
2017 A conf
Intelligent tutors as teachers' aides: exploring teacher needs for real-time analytics in blended classrooms.
LAK
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2017 A conf
SPACLE: investigating learning across virtual and physical spaces using spatial replays.
LAK
Kenneth Holstein, Bruce M. McLaren, Vincent Aleven
2016 — conf
Developing a Teacher Dashboard For Use with Intelligent Tutoring Systems.
IWTA@EC-TEL
Vincent Aleven, Franceska Xhakaj, Kenneth Holstein, Bruce M. McLaren
2016 — conf
Luna: A Dashboard for Teachers Using Intelligent Tutoring Systems.
IWTA@EC-TEL
Kenneth Holstein, Franceska Xhakaj, Vincent Aleven, Bruce M. McLaren
2016 — conf
Sequence Matters, But How Do I Discover How? Towards a Workflow for Evaluating Activity Sequences from Data.
EDM (Workshops)
Shayan Doroudi, Kenneth Holstein, Vincent Aleven, Emma Brunskill
2016 B conf
Sequence Matters, But How Exactly? A Method for Evaluating Activity Sequences from Data.
EDM
Shayan Doroudi, Kenneth Holstein, Vincent Aleven, Emma Brunskill
2015 B conf
Inferring causal structure and hidden causes from event sequences.
CogSci
Christopher G. Lucas, Kenneth Holstein, Michael Pacer
2015 B conf
Towards Understanding How to Leverage Sense-making, Induction/Refinement and Fluency to Improve Robust Learning.
EDM
Shayan Doroudi, Kenneth Holstein, Vincent Aleven, Emma Brunskill
2014 B conf
Discovering hidden causes using statistical evidence.
CogSci
Christopher G. Lucas, Kenneth Holstein, Charles Kemp