Eldon Schoop

28 papers A* 5A 5Journal 13Unranked 4
YearRankTypeTitle / Venue / Authors
2026 A conf
Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM.
IUI
Jon-Tait Beason, Ruijia Cheng, Eldon Schoop, Jeffrey Nichols
2026 A conf
Mapping the Design Space of User Experience for Computer Use Agents.
IUI
Ruijia Cheng, Jenny T. Liang, Eldon Schoop, Jeffrey Nichols
2026 J jnl
Mapping the Design Space of User Experience for Computer Use Agents.
CoRR
Ruijia Cheng, Jenny T. Liang, Eldon Schoop, Jeffrey Nichols
2025 J jnl
AgentBuilder: Exploring Scaffolds for Prototyping User Experiences of Interface Agents.
CoRR
Jenny T. Liang, Titus Barik, Jeffrey Nichols, Eldon Schoop, Ruijia Cheng
2025 J jnl
Athena: Intermediate Representations for Iterative Scaffolded App Generation with an LLM.
CoRR
Jazbo Beason, Ruijia Cheng, Eldon Schoop, Jeffrey Nichols
2025 A conf
From Interaction to Impact: Towards Safer AI Agent Through Understanding and Evaluating Mobile UI Operation Impacts.
IUI
Zhuohao (Jerry) Zhang, Eldon Schoop, Jeffrey Nichols, Anuj Mahajan, Amanda Swearngin
2025 A conf
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations.
IUI
Yue Jiang, Eldon Schoop, Amanda Swearngin, Jeffrey Nichols
2024 A* conf
AXNav: Replaying Accessibility Tests from Natural Language.
CHI
Maryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng, Yue Jiang, Jeffrey Nichols
2024 — conf
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs.
ECCV (64)
Keen You, Haotian Zhang, Eldon Schoop, Floris Weers, Amanda Swearngin, Jeffrey Nichols, Yinfei Yang, Zhe Gan
2024 J jnl
Ferret-UI: Grounded Mobile UI Understanding with Multimodal LLMs.
CoRR
Keen You, Haotian Zhang, Eldon Schoop, Floris Weers, Amanda Swearngin, Jeffrey Nichols, Yinfei Yang, Zhe Gan
2024 J jnl
From Interaction to Impact: Towards Safer AI Agents Through Understanding and Evaluating UI Operation Impacts.
CoRR
Zhuohao (Jerry) Zhang, Eldon Schoop, Jeffrey Nichols, Anuj Mahajan, Amanda Swearngin
2024 — conf
UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback.
NAACL-HLT
Jason Wu, Eldon Schoop, Alan Leung, Titus Barik, Jeffrey P. Bigham, Jeffrey Nichols
2024 J jnl
UICoder: Finetuning Large Language Models to Generate User Interface Code through Automated Feedback.
CoRR
Jason Wu, Eldon Schoop, Alan Leung, Titus Barik, Jeffrey P. Bigham, Jeffrey Nichols
2023 J jnl
AXNav: Replaying Accessibility Tests from Natural Language.
CoRR
Maryam Taeb, Amanda Swearngin, Eldon Schoop, Ruijia Cheng, Yue Jiang, Jeffrey Nichols
2023 J jnl
ILuvUI: Instruction-tuned LangUage-Vision modeling of UIs from Machine Conversations.
CoRR
Yue Jiang, Eldon Schoop, Amanda Swearngin, Jeffrey Nichols
2023 A* conf
Never-ending Learning of User Interfaces.
UIST
Jason Wu, Rebecca Krosnick, Eldon Schoop, Amanda Swearngin, Jeffrey P. Bigham, Jeffrey Nichols
2023 J jnl
Never-ending Learning of User Interfaces.
CoRR
Jason Wu, Rebecca Krosnick, Eldon Schoop, Amanda Swearngin, Jeffrey P. Bigham, Jeffrey Nichols
2022 — —
Exploratory and Explanatory Tools for ML Application Development
Eldon Schoop
2022 J jnl
IMACS: Image Model Attribution Comparison Summaries.
CoRR
Eldon Schoop, Ben Wedin, Andrei Kapishnikov, Tolga Bolukbasi, Michael Terry
2022 A* conf
Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis.
CHI
Eldon Schoop, Xin Zhou, Gang Li, Zhourong Chen, Bjoern Hartmann, Yang Li
2022 J jnl
Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis.
CoRR
Eldon Schoop, Xin Zhou, Gang Li, Zhourong Chen, Björn Hartmann, Yang Li
2021 J jnl
Sketch-based Creativity Support Tools using Deep Learning.
CoRR
Forrest Huang, Eldon Schoop, David Ha, Jeffrey Nichols, John F. Canny
2021 A* conf
UMLAUT: Debugging Deep Learning Programs using Program Structure and Model Behavior.
CHI
Eldon Schoop, Forrest Huang, Bjoern Hartmann
2020 — conf
SCRAM: Simple Checks for Realtime Analysis of Model Training for Non-Expert ML Programmers.
CHI Extended Abstracts
Eldon Schoop, Forrest Huang, Björn Hartmann
2020 J jnl
Scones: Towards Conversational Authoring of Sketches.
CoRR
Forrest Huang, Eldon Schoop, David Ha, John F. Canny
2020 A conf
Scones: towards conversational authoring of sketches.
IUI
Forrest Huang, Eldon Schoop, David Ha, John F. Canny
2018 A* conf
HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video.
CHI
Eldon Schoop, James Smith, Bjoern Hartmann
2016 — conf
Drill Sergeant: Supporting Physical Construction Projects through an Ecosystem of Augmented Tools.
CHI Extended Abstracts
Eldon Schoop, Michelle Nguyen, Dahyun Daniel Lim, Valkyrie Savage, Sean Follmer, Björn Hartmann