Jordan Lee Boyd-Graber

32 papers A* 2B 1Journal 16Unranked 13
YearRankTypeTitle / Venue / Authors
2026 J jnl
BenchMarker: An Education-Inspired Toolkit for Highlighting Flaws in Multiple-Choice Benchmarks.
CoRR
Nishant Balepur, Bhavya Rajasekaran, Jane Oh, Michael Xie, Atrey Desai, Vipul Gupta, Steven James Moore, Eunsol Choi, Rachel Rudinger, Jordan Lee Boyd-Graber
2026 J jnl
Language Models Don't Know What You Want: Evaluating Personalization in Deep Research Needs Real Users.
CoRR
Nishant Balepur, Malachi Hamada, Varsha Kishore, Sergey Feldman, Amanpreet Singh, Pao Siangliulue, Joseph Chee Chang, Eunsol Choi, Jordan Lee Boyd-Graber, Aakanksha Naik
2026 — conf
SMART-Editor: A Multi-Agent Framework for Human-Like Design Editing with Structural Integrity.
EACL (Findings)
Ishani Mondal, Meera Bharadwaj, Ayush Roy, Aparna Garimella, Jordan Lee Boyd-Graber
2025 A* conf
A Good Plan is Hard to Find: Aligning Models with Preferences is Misaligned with What Helps Users.
EMNLP
Nishant Balepur, Matthew Shu, Yoo Yeon Sung, Seraphina Goldfarb-Tarrant, Shi Feng, Fumeng Yang, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 J jnl
A Good Plan is Hard to Find: Aligning Models with Preferences is Misaligned with What Helps Users.
CoRR
Nishant Balepur, Matthew Shu, Yoo Yeon Sung, Seraphina Goldfarb-Tarrant, Shi Feng, Fumeng Yang, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 B conf
ADAPTIVE IE: Investigating the Complementarity of Human-AI Collaboration to Adaptively Extract Information on-the-fly.
COLING
Ishani Mondal, Michelle Yuan, Anandhavelu Natarajan, Aparna Garimella, Francis Ferraro, Andrew Blair-Stanek, Benjamin Van Durme, Jordan Lee Boyd-Graber
2025 A* conf
Discrepancy Detection at the Data Level: Toward Consistent Multilingual Question Answering.
EMNLP
Lorena Calvo-Bartolomé, Valérie Aldana, Karla Cantarero, Alonso Madroñal de Mesa, Jerónimo Arenas-García, Jordan Lee Boyd-Graber
2025 — conf
GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration.
ACL (1)
Yoo Yeon Sung, Eve Fleisig, Yu Hou, Ishan Upadhyay, Jordan Lee Boyd-Graber
2025 J jnl
GRACE: A Granular Benchmark for Evaluating Model Calibration against Human Calibration.
CoRR
Yoo Yeon Sung, Eve Fleisig, Yufang Hou, Ishan Upadhyay, Jordan Lee Boyd-Graber
2025 — conf
Group Preference Alignment: Customizing LLM Responses from In-Situ Conversations Only When Needed.
EMNLP (Industry Track)
Ishani Mondal, Jack W. Stokes, Sujay Kumar Jauhar, Longqi Yang, Mengting Wan, Xiaofeng Xu, Xia Song, Jordan Lee Boyd-Graber, Jennifer Neville
2025 — conf
Is your benchmark truly adversarial? AdvScore: Evaluating Human-Grounded Adversarialness.
NAACL (Long Papers)
Yoo Yeon Sung, Maharshi Gor, Eve Fleisig, Ishani Mondal, Jordan Lee Boyd-Graber
2025 J jnl
Large Language Models Are Effective Human Annotation Assistants, But Not Good Independent Annotators.
CoRR
Feng Gu, Zongxia Li, Carlos Rafael Colon, Benjamin Evans, Ishani Mondal, Jordan Lee Boyd-Graber
2025 — conf
Large Language Models Struggle to Describe the Haystack without Human Help: A Social Science-Inspired Evaluation of Topic Models.
ACL (1)
Zongxia Li, Lorena Calvo-Bartolomé, Alexander Miserlis Hoyle, Paiheng Xu, Daniel Kofi Stephens, Juan Francisco Fung, Alden Dima, Jordan Lee Boyd-Graber
2025 — conf
MoDS: Moderating a Mixture of Document Speakers to Summarize Debatable Queries in Document Collections.
NAACL (Long Papers)
Nishant Balepur, Alexa F. Siu, Nedim Lipka, Franck Dernoncourt, Tong Sun, Jordan Lee Boyd-Graber, Puneet Mathur
2025 — conf
No Questions are Stupid, but some are Poorly Posed: Understanding Poorly-Posed Information-Seeking Questions.
ACL (1)
Neha Srikanth, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 — conf
Personalized Help for Optimizing Low-Skilled Users' Strategy.
NAACL (Short Papers)
Feng Gu, Wichayaporn Wongkamjan, Jordan Lee Boyd-Graber, Jonathan K. Kummerfeld, Denis Peskoff, Jonathan May
2025 — conf
ProxAnn: Use-Oriented Evaluations of Topic Models and Document Clustering.
ACL (1)
Alexander Miserlis Hoyle, Lorena Calvo-Bartolomé, Jordan Lee Boyd-Graber, Philip Resnik
2025 — conf
Reverse Question Answering: Can an LLM Write a Question so Hard (or Bad) that it Can't Answer?
NAACL (Short Papers)
Nishant Balepur, Feng Gu, Abhilasha Ravichander, Shi Feng, Jordan Lee Boyd-Graber, Rachel Rudinger
2025 J jnl
Semantically-Aware Rewards for Open-Ended R1 Training in Free-Form Generation.
CoRR
Zongxia Li, Yapei Chang, Yuhang Zhou, Xiyang Wu, Zichao Liang, Yoo Yeon Sung, Jordan Lee Boyd-Graber
2025 — conf
Should I Trust You? Detecting Deception in Negotiations using Counterfactual RL.
ACL (Findings)
Wichayaporn Wongkamjan, Yanze Wang, Feng Gu, Denis Peskoff, Jonathan K. Kummerfeld, Jonathan May, Jordan Lee Boyd-Graber
2025 J jnl
Should I Trust You? Detecting Deception in Negotiations using Counterfactual RL.
CoRR
Wichayaporn Wongkamjan, Yanze Wang, Feng Gu, Denis Peskoff, Jonathan K. Kummerfeld, Jonathan May, Jordan Lee Boyd-Graber
2025 J jnl
VideoHallu: Evaluating and Mitigating Multi-modal Hallucinations on Synthetic Video Understanding.
CoRR
Zongxia Li, Xiyang Wu, Guangyao Shi, Yubin Qin, Hongyang Du, Tianyi Zhou, Dinesh Manocha, Jordan Lee Boyd-Graber
2025 — conf
Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above.
ACL (1)
Nishant Balepur, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 J jnl
Which of These Best Describes Multiple Choice Evaluation with LLMs? A) Forced B) Flawed C) Fixable D) All of the Above.
CoRR
Nishant Balepur, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 — conf
Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas.
ACL (1)
Nishant Balepur, Vishakh Padmakumar, Fumeng Yang, Shi Feng, Rachel Rudinger, Jordan Lee Boyd-Graber
2025 J jnl
Whose Boat Does it Float? Improving Personalization in Preference Tuning via Inferred User Personas.
CoRR
Nishant Balepur, Vishakh Padmakumar, Fumeng Yang, Shi Feng, Rachel Rudinger, Jordan Lee Boyd-Graber
2024 J jnl
ADVSCORE: A Metric for the Evaluation and Creation of Adversarial Benchmarks.
CoRR
Yoo Yeon Sung, Eve Fleisig, Ishani Mondal, Jordan Lee Boyd-Graber
2024 J jnl
AUTOHALLUSION: Automatic Generation of Hallucination Benchmarks for Vision-Language Models.
CoRR
Xiyang Wu, Tianrui Guan, Dianqi Li, Shuaiyi Huang, Xiaoyu Liu, Xijun Wang, Ruiqi Xian, Abhinav Shrivastava, Furong Huang, Jordan Lee Boyd-Graber, Tianyi Zhou, Dinesh Manocha
2024 J jnl
More Victories, Less Cooperation: Assessing Cicero's Diplomacy Play.
CoRR
Wichayaporn Wongkamjan, Feng Gu, Yanze Wang, Ulf Hermjakob, Jonathan May, Brandon M. Stewart, Jonathan K. Kummerfeld, Denis Peskoff, Jordan Lee Boyd-Graber
2024 J jnl
PANDA (Pedantic ANswer-correctness Determination and Adjudication): Improving Automatic Evaluation for Question Answering and Text Generation.
CoRR
Zongxia Li, Ishani Mondal, Yijun Liang, Huy Nghiem, Jordan Lee Boyd-Graber
2024 J jnl
Personalized Help for Optimizing Low-Skilled Users' Strategy.
CoRR
Feng Gu, Wichayaporn Wongkamjan, Jordan Lee Boyd-Graber, Jonathan K. Kummerfeld, Denis Peskoff, Jonathan May
2023 J jnl
Bridging Background Knowledge Gaps in Translation with Automatic Explicitation.
CoRR
HyoJung Han, Jordan Lee Boyd-Graber, Marine Carpuat