Matthew Lease

180 papers A* 25A 10B 12C 1Misc 5Journal 82Unranked 42
YearRankTypeTitle / Venue / Authors
2026 J jnl
Who Owns Creativity and Who Does the Work? Trade-offs in LLM-Supported Research Ideation.
CoRR
Houjiang Liu, Yujin Choi, Sanjana Gautam, Gabriel Jaffe, Soo Young Rieh, Matthew Lease
2025 J jnl
Beyond Sociodemographic Prompting: Using Supervision to Align LLMs with Human Response Distributions.
CoRR
Gauri Kambhatla, Sanjana Gautam, Angela Zhang, Alex Liu, Ravi Srinivasan, Junyi Jessy Li, Matthew Lease
2025 J jnl
Explgagement With Misinformation During a Health Crisis.
Proc. ACM Hum. Comput. Interact.
Houjiang Liu, Jacek Gwizdka, Matthew Lease
2025 J jnl
Exploring Multidimensional Checkworthiness: Designing AI-assisted Claim Prioritization for Human Fact-checkers.
Proc. ACM Hum. Comput. Interact.
Houjiang Liu, Jacek Gwizdka, Matthew Lease
2025 J jnl
Finding Pareto trade-offs in fair and accurate detection of toxic speech.
Inf. Res.
Soumyajit Gupta, Venelin Kovatchev, Anubrata Das, Maria De-Arteaga, Matthew Lease
2025 J jnl
Instance-level Performance Prediction for Long-form Generation Tasks.
CoRR
Chi-Yang Hsu, Alexander Braylan, Yiheng Su, Omar Alonso, Matthew Lease
2025 Misc conf
Preaching to the ChoIR: Lessons IR Should Share with AI.
ICTIR
Gianluca Demartini, Claudia Hauff, Matthew Lease, Stefano Mizzaro, Kevin Roitero, Mark Sanderson, Falk Scholer, Chirag Shah, Damiano Spina, Paul Thomas, Arjen P. de Vries, Guido Zuccon
2025 J jnl
Rhetorical XAI: Explaining AI's Benefits as well as its Use via Rhetorical Design.
CoRR
Houjiang Liu, Yiheng Su, Matthew Lease
2024 A* conf
A General Model for Aggregating Annotations AcrossSimple, Complex, and Multi-object Annotation Tasks (Abstract Reprint).
AAAI
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
2024 — conf
Annorama: Enabling Immersive At-Desk Annotation Experiences in Virtual Reality with 3D Point Cloud Dioramas.
SUI
Subramanian Chidambaram, Alex C. Williams, Min Bai, Satyugjit Virk, Patrick Haffner, Matthew Lease, Li Erran Li
2024 J jnl
Argumentative Experience: Reducing Confirmation Bias on Controversial Issues through LLM-Generated Multi-Persona Debates.
CoRR
Li Shi, Houjiang Liu, Yian Wong, Utkarsh Mujumdar, Dan Zhang, Jacek Gwizdka, Matthew Lease
2024 — conf
Benchmark Transparency: Measuring the Impact of Data on Evaluation.
NAACL-HLT
Venelin Kovatchev, Matthew Lease
2024 J jnl
Benchmark Transparency: Measuring the Impact of Data on Evaluation.
CoRR
Venelin Kovatchev, Matthew Lease
2024 J jnl
DMLR: Data-centric Machine Learning Research - Past, Present and Future.
J. Data-centric Mach. Learn. Res.
Luis Oala, Manil Maskey, Lilith Bat-Leah, Alicia Parrish, Nezihe Merve Gürel, Tzu-Sheng Kuo, Yang Liu, Rotem Dror, Danilo Brajovic, Xiaozhe Yao, Max Bartolo, William Gaviria Rojas, Ryan Hileman, Rainier Aliment, Michael W. Mahoney, Meg Risdal, Matthew Lease, Wojciech Samek, Debojyoti Dutta, Curtis G. Northcutt, Cody Coleman, Braden Hancock, Bernard Koch, Girmaw Abebe Tadesse, Bojan Karlas, Ahmed Alaa, Adji Bousso Dieng, Natasha F. Noy, Vijay Janapa Reddi, James Zou, Praveen K. Paritosh, Mihaela van der Schaar, Kurt Bollacker, Lora Aroyo, Ce Zhang, Joaquin Vanschoren, Isabelle Guyon, Peter Mattson
2024 J jnl
Diverse, but Divisive: LLMs Can Exaggerate Gender Differences in Opinion Related to Harms of Misinformation.
CoRR
Terrence Neumann, Sooyong Lee, Maria De-Arteaga, Sina Fazelpour, Matthew Lease
2024 J jnl
Exploring Multidimensional Checkworthiness: Designing AI-assisted Claim Prioritization for Human Fact-checkers.
CoRR
Houjiang Liu, Jacek Gwizdka, Matthew Lease
2024 J jnl
Fairly Accurate: Optimizing Accuracy Parity in Fair Target-Group Detection.
CoRR
Soumyajit Gupta, Venelin Kovatchev, Maria De-Arteaga, Matthew Lease
2024 J jnl
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI.
Proc. ACM Hum. Comput. Interact.
Houjiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou, Daisy Pinaroc, Matthew Lease, Min Kyung Lee
2024 — conf
Promoting Constructive Deliberation: Reframing for Receptiveness.
EMNLP (Findings)
Gauri Kambhatla, Matthew Lease, Ashwin Rajadesingan
2024 J jnl
Promoting Constructive Deliberation: Reframing for Receptiveness.
CoRR
Gauri Kambhatla, Matthew Lease, Ashwin Rajadesingan
2024 A conf
Snapper: Accelerating Bounding Box Annotation in Object Detection Tasks with Find-and-Snap Tooling.
IUI
Alex C. Williams, Min Bai, Jonathan Buck, Tristan J. McKinney, Amy Rechkemmer, Koushik Kalyanaraman, Matthew Lease, Patrick Haffner, Xiong Zhou, Li Erran Li
2023 J jnl
A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks.
CoRR
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
2023 J jnl
A General Model for Aggregating Annotations Across Simple, Complex, and Multi-Object Annotation Tasks.
J. Artif. Intell. Res.
Alexander Braylan, Madalyn Marabella, Omar Alonso, Matthew Lease
2023 J jnl
DMLR: Data-centric Machine Learning Research - Past, Present and Future.
CoRR
Luis Oala, Manil Maskey, Lilith Bat-Leah, Alicia Parrish, Nezihe Merve Gürel, Tzu-Sheng Kuo, Yang Liu, Rotem Dror, Danilo Brajovic, Xiaozhe Yao, Max Bartolo, William Gaviria Rojas, Ryan Hileman, Rainier Aliment, Michael W. Mahoney, Meg Risdal, Matthew Lease, Wojciech Samek, Debojyoti Dutta, Curtis G. Northcutt, Cody Coleman, Braden Hancock, Bernard Koch, Girmaw Abebe Tadesse, Bojan Karlas, Ahmed M. Alaa, Adji Bousso Dieng, Natasha F. Noy, Vijay Janapa Reddi, James Zou, Praveen K. Paritosh, Mihaela van der Schaar, Kurt Bollacker, Lora Aroyo, Ce Zhang, Joaquin Vanschoren, Isabelle Guyon, Peter Mattson
2023 — conf
Designing Closed-Loop Models for Task Allocation.
HHAI
Vijay Keswani, L. Elisa Celis, Krishnaram Kenthapadi, Matthew Lease
2023 J jnl
Designing Closed-Loop Models for Task Allocation.
CoRR
Vijay Keswani, L. Elisa Celis, Krishnaram Kenthapadi, Matthew Lease
2023 J jnl
Editorial: Human-centered AI: Crowd computing.
Frontiers Artif. Intell.
Jie Yang, Alessandro Bozzon, Ujwal Gadiraju, Matthew Lease
2023 J jnl
How Crowd Worker Factors Influence Subjective Annotations: A Study of Tagging Misogynistic Hate Speech in Tweets.
CoRR
Danula Hettiachchi, Indigo Holcombe-James, Stephanie Livingstone, Anjalee de Silva, Matthew Lease, Flora D. Salim, Mark Sanderson
2023 J jnl
Human-centered NLP Fact-checking: Co-Designing with Fact-checkers using Matchmaking for AI.
CoRR
Houjiang Liu, Anubrata Das, Alexander Boltz, Didi Zhou, Daisy Pinaroc, Matthew Lease, Min Kyung Lee
2023 J jnl
Interpretable by Design: Wrapper Boxes Combine Neural Performance with Faithful Explanations.
CoRR
Yiheng Su, Junyi Jessy Li, Matthew Lease
2023 J jnl
Learning Complementary Policies for Human-AI Teams.
CoRR
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Wei Sun, Min Kyung Lee, Matthew Lease
2023 — conf
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches.
ECIR (2)
Mehmet Deniz Türkmen, Matthew Lease, Mücahid Kutlu
2023 J jnl
New Metrics to Encourage Innovation and Diversity in Information Retrieval Approaches.
CoRR
Mehmet Deniz Türkmen, Matthew Lease, Mücahid Kutlu
2023 A* conf
Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection.
WWW
Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga, Matthew Lease
2023 J jnl
Same Same, But Different: Conditional Multi-Task Learning for Demographic-Specific Toxicity Detection.
CoRR
Soumyajit Gupta, Sooyong Lee, Maria De-Arteaga, Matthew Lease
2023 J jnl
The State of Human-centered NLP Technology for Fact-checking.
CoRR
Anubrata Das, Houjiang Liu, Venelin Kovatchev, Matthew Lease
2023 J jnl
The state of human-centered NLP technology for fact-checking.
Inf. Process. Manag.
Anubrata Das, Houjiang Liu, Venelin Kovatchev, Matthew Lease
2022 J jnl
Data excellence for AI: why should you care?
Interactions
Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann
2022 J jnl
Designing Closed Human-in-the-loop Deferral Pipelines.
CoRR
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
2022 J jnl
Fairly Accurate: Learning Optimal Accuracy vs. Fairness Tradeoffs for Hate Speech Detection.
CoRR
Venelin Kovatchev, Soumyajit Gupta, Matthew Lease
2022 J jnl
In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers.
Frontiers Artif. Intell.
Vivek Krishna Pradhan, Mike Schaekermann, Matthew Lease
2022 A conf
Learning a neural Pareto manifold extractor with constraints.
UAI
Soumyajit Gupta, Gurpreet Singh, Raghu Bollapragada, Matthew Lease
2022 A* conf
Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks.
WWW
Alexander Braylan, Omar Alonso, Matthew Lease
2022 J jnl
Measuring Annotator Agreement Generally across Complex Structured, Multi-object, and Free-text Annotation Tasks.
CoRR
Alexander Braylan, Omar Alonso, Matthew Lease
2022 — conf
ProtoTEx: Explaining Model Decisions with Prototype Tensors.
ACL (1)
Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease, Junyi Jessy Li
2022 J jnl
ProtoTEx: Explaining Model Decisions with Prototype Tensors.
CoRR
Anubrata Das, Chitrank Gupta, Venelin Kovatchev, Matthew Lease, Junyi Jessy Li
2022 J jnl
The Effects of Interactive AI Design on User Behavior: An Eye-tracking Study of Fact-checking COVID-19 Claims.
CoRR
Li Shi, Nilavra Bhattacharya, Anubrata Das, Matthew Lease, Jacek Gwizdka
2022 — conf
Understanding and Predicting Characteristics of Test Collections in Information Retrieval.
iConference (2)
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
2022 J jnl
Voices of Workers: Why a Worker-Centered Approach to Crowd Work Is Challenging.
CoRR
Caifan Du, Matthew Lease
2022 — conf
You Are What You Tweet: Profiling Users by Past Tweets to Improve Hate Speech Detection.
iConference (2)
Prateek Chaudhry, Matthew Lease
2022 J jnl
longhorns at DADC 2022: How many linguists does it take to fool a Question Answering model? A systematic approach to adversarial attacks.
CoRR
Venelin Kovatchev, Trina Chatterjee, Venkata Subrahmanyan Govindarajan, Jifan Chen, Eunsol Choi, Gabriella Chronis, Anubrata Das, Katrin Erk, Matthew Lease, Junyi Jessy Li, Yating Wu, Kyle Mahowald
2021 J jnl
A Hybrid 2-stage Neural Optimization for Pareto Front Extraction.
CoRR
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
2021 A* conf
Aggregating Complex Annotations via Merging and Matching.
KDD
Alexander Braylan, Matthew Lease
2021 J jnl
An Information Retrieval Approach to Building Datasets for Hate Speech Detection.
CoRR
Md. Mustafizur Rahman, Dinesh Balakrishnan, Dhiraj Murthy, Mücahid Kutlu, Matthew Lease
2021 J jnl
Data Excellence for AI: Why Should You Care.
CoRR
Lora Aroyo, Matthew Lease, Praveen K. Paritosh, Mike Schaekermann
2021 A* conf
Human-AI Collaboration with Bandit Feedback.
IJCAI
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Min Kyung Lee, Matthew Lease
2021 J jnl
Human-AI Collaboration with Bandit Feedback.
CoRR
Ruijiang Gao, Maytal Saar-Tsechansky, Maria De-Arteaga, Ligong Han, Min Kyung Lee, Matthew Lease
2021 J jnl
In Search of Ambiguity: A Three-Stage Workflow Design to Clarify Annotation Guidelines for Crowd Workers.
CoRR
Vivek Krishna Pradhan, Mike Schaekermann, Matthew Lease
2021 — conf
Investigating and Mitigating Biases in Crowdsourced Data.
CSCW Companion
Danula Hettiachchi, Mark Sanderson, Jorge Gonçalves, Simo Hosio, Gabriella Kazai, Matthew Lease, Mike Schaekermann, Emine Yilmaz
2021 Misc conf
Pareto Solutions vs Dataset Optima: Concepts and Methods for Optimizing Competing Objectives with Constraints in Retrieval.
ICTIR
Soumyajit Gupta, Gurpreet Singh, Anubrata Das, Matthew Lease
2021 J jnl
Proceedings of the CSCW 2021 Workshop - Investigating and Mitigating Biases in Crowdsourced Data.
CoRR
Danula Hettiachchi, Mark Sanderson, Jorge Gonçalves, Simo Hosio, Gabriella Kazai, Matthew Lease, Mike Schaekermann, Emine Yilmaz
2021 J jnl
SCA-Net: A Self-Correcting Two-Layer Autoencoder for Hyper-spectral Unmixing.
CoRR
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
2021 J jnl
Scalable Uni-directional Pareto Optimality for Multi-Task Learning with Constraints.
CoRR
Soumyajit Gupta, Gurpreet Singh, Matthew Lease
2021 J jnl
The Case for Claim Difficulty Assessment in Automatic Fact Checking.
CoRR
Prakhar Singh, Anubrata Das, Junyi Jessy Li, Matthew Lease
2021 J jnl
The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help.
CoRR
Danula Hettiachchi, Mike Schaekermann, Tristan McKinney, Matthew Lease
2021 J jnl
The Challenge of Variable Effort Crowdsourcing and How Visible Gold Can Help.
Proc. ACM Hum. Comput. Interact.
Danula Hettiachchi, Mike Schaekermann, Tristan McKinney, Matthew Lease
2021 A* conf
The Psychological Well-Being of Content Moderators: The Emotional Labor of Commercial Moderation and Avenues for Improving Support.
CHI
Miriah Steiger, Timir J. Bharucha, Sukrit Venkatagiri, Martin J. Riedl, Matthew Lease
2021 C conf
Towards Unbiased and Accurate Deferral to Multiple Experts.
AIES
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
2021 J jnl
Towards Unbiased and Accurate Deferral to Multiple Experts.
CoRR
Vijay Keswani, Matthew Lease, Krishnaram Kenthapadi
2020 J jnl
Annotator Rationales for Labeling Tasks in Crowdsourcing.
J. Artif. Intell. Res.
Mücahid Kutlu, Tyler McDonnell, Tamer Elsayed, Matthew Lease
2020 Misc conf
Efficient Test Collection Construction via Active Learning.
ICTIR
Md. Mustafizur Rahman, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2020 J jnl
Extracting Optimal Solution Manifolds using Constrained Neural Optimization.
CoRR
Gurpreet Singh, Soumyajit Gupta, Matthew Lease
2020 B conf
Fast, Accurate, and Healthier: Interactive Blurring Helps Moderators Reduce Exposure to Harmful Content.
HCOMP
Anubrata Das, Brandon Dang, Matthew Lease
2020 A* conf
Modeling and Aggregation of Complex Annotations via Annotation Distances.
WWW
Alexander Braylan, Matthew Lease
2020 J jnl
Streaming Singular Value Decomposition for Big Data Applications.
CoRR
Gurpreet Singh, Soumyajit Gupta, Matthew Lease, Clint Dawson
2020 J jnl
Understanding and Predicting the Characteristics of Test Collections.
CoRR
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
2020 J jnl
You Are What You Tweet: Profiling Users by Past Tweets to Improve Hate Speech Detection.
CoRR
Prateek Chaudhry, Matthew Lease
2019 J jnl
A Conceptual Framework for Evaluating Fairness in Search.
CoRR
Anubrata Das, Matthew Lease
2019 J jnl
CobWeb: A Research Prototype for Exploring User Bias in Political Fact-Checking.
CoRR
Anubrata Das, Kunjan Mehta, Matthew Lease
2019 A* conf
Constructing Test Collections using Multi-armed Bandits and Active Learning.
WWW
Md. Mustafizur Rahman, Mücahid Kutlu, Matthew Lease
2019 — conf
Correlation, Prediction and Ranking of Evaluation Metrics in Information Retrieval.
ECIR (1)
Soumyajit Gupta, Mücahid Kutlu, Vivek Khetan, Matthew Lease
2019 A conf
Explainable modeling of annotations in crowdsourcing.
IUI
An T. Nguyen, Matthew Lease, Byron C. Wallace
2019 J jnl
FACTS-IR: fairness, accountability, confidentiality, transparency, and safety in information retrieval.
SIGIR Forum
Alexandra Olteanu, Jean Garcia-Gathright, Maarten de Rijke, Michael D. Ekstrand, Adam Roegiest, Aldo Lipani, Alex Beutel, Ana Lucic, Ana-Andreea Stoica, Anubrata Das, Asia Biega, Bart Voorn, Claudia Hauff, Damiano Spina, David D. Lewis, Douglas W. Oard, Emine Yilmaz, Faegheh Hasibi, Gabriella Kazai, Graham McDonald, Hinda Haned, Iadh Ounis, Ilse van der Linden, Joris Baan, Kamuela N. Lau, Krisztian Balog, Mahmoud F. Sayed, Maria Panteli, Mark Sanderson, Matthew Lease, Preethi Lahoti, Toshihiro Kamishima
2018 A* conf
An Interpretable Joint Graphical Model for Fact-Checking From Crowds.
AAAI
An T. Nguyen, Aditya Kharosekar, Matthew Lease, Byron C. Wallace
2018 A* conf
Believe it or not: Designing a Human-AI Partnership for Mixed-Initiative Fact-Checking.
UIST
An T. Nguyen, Aditya Kharosekar, Saumyaa Krishnan, Siddhesh Krishnan, Elizabeth Tate, Byron C. Wallace, Matthew Lease
2018 J jnl
Correlation and Prediction of Evaluation Metrics in Information Retrieval.
CoRR
Mücahid Kutlu, Vivek Khetan, Matthew Lease
2018 A* conf
Crowd vs. Expert: What Can Relevance Judgment Rationales Teach Us About Assessor Disagreement?
SIGIR
Mücahid Kutlu, Tyler McDonnell, Yassmine Barkallah, Tamer Elsayed, Matthew Lease
2018 — ch.
Crowdsourcing and Human Computation: Introduction.
Encyclopedia of Social Network Analysis and Mining. 2nd Ed.
Matthew Lease, Omar Alonso
2018 J jnl
Efficient Test Collection Construction via Active Learning.
CoRR
Md. Mustafizur Rahman, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2018 — conf
Fact Checking and Information Retrieval.
DESIRES
Matthew Lease
2018 J jnl
Intelligent topic selection for low-cost information retrieval evaluation: A New perspective on deep vs. shallow judging.
Inf. Process. Manag.
Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2018 — conf
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably.
DESIRES
Mücahid Kutlu, Tyler McDonnell, Aashish Sheshadri, Tamer Elsayed, Matthew Lease
2018 J jnl
Mix and Match: Collaborative Expert-Crowd Judging for Building Test Collections Accurately and Affordably.
CoRR
Mücahid Kutlu, Tyler McDonnell, Aashish Sheshadri, Tamer Elsayed, Matthew Lease
2018 J jnl
Neural information retrieval: at the end of the early years.
Inf. Retr. J.
Kezban Dilek Onal, Ye Zhang, Ismail Sengor Altingovde, Md. Mustafizur Rahman, Pinar Karagoz, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek Khetan, Tyler McDonnell, An Thanh Nguyen, Dan Xu, Byron C. Wallace, Maarten de Rijke, Matthew Lease
2018 J jnl
Reports of the Workshops Held at the Sixth AAAI Conference on Human Computation and Crowdsourcing.
AI Mag.
Lora Aroyo, Anca Dumitrache, Jeffrey V. Nickerson, Matthew Lease, Pietro Michelucci
2018 J jnl
Toward Safer Crowdsourced Content Moderation.
CoRR
Brandon Dang, Martin J. Riedl, Matthew Lease
2018 A conf
When Rank Order Isn't Enough: New Statistical-Significance-Aware Correlation Measures.
CIKM
Mücahid Kutlu, Tamer Elsayed, Maram Hasanain, Matthew Lease
2018 B conf
Your Behavior Signals Your Reliability: Modeling Crowd Behavioral Traces to Ensure Quality Relevance Annotations.
HCOMP
Tanya Goyal, Tyler McDonnell, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2017 A* conf
Active Discriminative Text Representation Learning.
AAAI
Ye Zhang, Matthew Lease, Byron C. Wallace
2017 — conf
Aggregating and Predicting Sequence Labels from Crowd Annotations.
ACL (1)
An Thanh Nguyen, Byron C. Wallace, Junyi Jessy Li, Ani Nenkova, Matthew Lease
2017 — conf
Bullseye: structured passage retrieval and document highlighting for scholarly search.
ACSW
Xi Zheng, Akanksha Bansal, Matthew Lease
2017 J jnl
Design Activism for Minimum Wage Crowd Work.
CoRR
Akash Mankar, Riddhi J. Shah, Matthew Lease
2017 — conf
Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization.
ACL (2)
Ye Zhang, Matthew Lease, Byron C. Wallace
2017 J jnl
Exploiting Domain Knowledge via Grouped Weight Sharing with Application to Text Categorization.
CoRR
Ye Zhang, Matthew Lease, Byron C. Wallace
2017 J jnl
Learning to Effectively Select Topics For Information Retrieval Test Collections.
CoRR
Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2017 A* conf
The Many Benefits of Annotator Rationales for Relevance Judgments.
IJCAI
Tyler McDonnell, Mücahid Kutlu, Tamer Elsayed, Matthew Lease
2016 A conf
A Correlated Worker Model for Grouped, Imbalanced and Multitask Data.
UAI
An T. Nguyen, Byron C. Wallace, Matthew Lease
2016 A* conf
ArabicWeb16: A New Crawl for Today's Arabic Web.
SIGIR
Reem Suwaileh, Mücahid Kutlu, Nihal Fathima, Tamer Elsayed, Matthew Lease
2016 J jnl
Crowdsourcing Information Extraction for Biomedical Systematic Reviews.
CoRR
Yalin Sun, Pengxiang Cheng, Shengwei Wang, Hao Lyu, Matthew Lease, Iain James Marshall, Byron C. Wallace
2016 J jnl
MmmTurkey: A Crowdsourcing Framework for Deploying Tasks and Recording Worker Behavior on Amazon Mechanical Turk.
CoRR
Brandon Dang, Miles Hutson, Matthew Lease
2016 J jnl
Neural Information Retrieval: A Literature Review.
CoRR
Ye Zhang, Md. Mustafizur Rahman, Alex Braylan, Brandon Dang, Heng-Lu Chang, Henna Kim, Quinten McNamara, Aaron Angert, Edward Banner, Vivek Khetan, Tyler McDonnell, An Thanh Nguyen, Dan Xu, Byron C. Wallace, Matthew Lease
2016 B conf
Probabilistic Modeling for Crowdsourcing Partially-Subjective Ratings.
HCOMP
An Thanh Nguyen, Matthew Halpern, Byron C. Wallace, Matthew Lease
2016 B ed.
Proceedings of the Fourth AAAI Conference on Human Computation and Crowdsourcing, HCOMP 2016, 30 October - 3 November, 2016, Austin, Texas, USA.
HCOMP
Arpita Ghosh, Matthew Lease
2016 B conf
Why Is That Relevant? Collecting Annotator Rationales for Relevance Judgments.
HCOMP
Tyler McDonnell, Matthew Lease, Mücahid Kutlu, Tamer Elsayed
2015 A conf
A Discriminative Approach to Predicting Assessor Accuracy.
ECIR
Hyun Joon Jung, Matthew Lease
2015 B conf
Combining Crowd and Expert Labels Using Decision Theoretic Active Learning.
HCOMP
An Thanh Nguyen, Byron C. Wallace, Matthew Lease
2015 B conf
Modeling Temporal Crowd Work Quality with Limited Supervision.
HCOMP
Hyun Joon Jung, Matthew Lease
2014 J jnl
Bullseye: Structured Passage Retrieval and Document Highlighting for Scholarly Search.
CoRR
Xi Zheng, Akanksha Bansal, Matthew Lease
2014 — ch.
Crowdsourcing and Human Computation, Introduction.
Encyclopedia of Social Network Analysis and Mining
Matthew Lease, Omar Alonso
2014 A* conf
Multidimensional relevance modeling via psychometrics and crowdsourcing.
SIGIR
Yinglong Zhang, Jin Zhang, Matthew Lease, Jacek Gwizdka
2014 B conf
Predicting Next Label Quality: A Time-Series Model of Crowdwork.
HCOMP
Hyun Joon Jung, Yubin Park, Matthew Lease
2014 J jnl
TurKPF: TurKontrol as a Particle Filter.
CoRR
Ethan Petuchowski, Matthew Lease
2013 J jnl
Beyond AMT: An Analysis of Crowd Work Platforms.
CoRR
Donna Vakharia, Matthew Lease
2013 J jnl
Crowdsourced Task Routing via Matrix Factorization.
CoRR
Hyun Joon Jung, Matthew Lease
2013 J jnl
Crowdsourcing for information retrieval: introduction to the special issue.
Inf. Retr.
Matthew Lease, Emine Yilmaz
2013 A* conf
Improving bug localization using structured information retrieval.
ASE
Ripon K. Saha, Matthew Lease, Sarfraz Khurshid, Dewayne E. Perry
2013 — conf
Overview of the TREC 2013 Crowdsourcing Track.
TREC
Mark D. Smucker, Gabriella Kazai, Matthew Lease
2013 B conf
SQUARE: A Benchmark for Research on Computing Crowd Consensus.
HCOMP
Aashish Sheshadri, Matthew Lease
2013 — conf
SQUARE: Benchmarking Crowd Consensus at MediaEval.
MediaEval
Aashish Sheshadri, Matthew Lease
2012 J jnl
Crowdsourcing for Usability Testing
CoRR
Di Liu, Matthew Lease, Rebecca Kuipers, Randolph G. Bias
2012 A* conf
Crowdsourcing for search evaluation and social-algorithmic search.
SIGIR
Matthew Lease, Omar Alonso
2012 — conf
Crowdsourcing for usability testing.
ASIST
Di Liu, Randolph G. Bias, Matthew Lease, Rebecca Kuipers
2012 J jnl
Dating Texts without Explicit Temporal Cues
CoRR
Abhimanu Kumar, Jason Baldridge, Matthew Lease, Joydeep Ghosh
2012 J jnl
Evaluating Classifiers Without Expert Labels
CoRR
Hyun Joon Jung, Matthew Lease
2012 — conf
Finding and exploring memes in social media.
HT
Hohyon Ryu, Matthew Lease, Nicholas Woodward
2012 — conf
Improving Quality of Crowdsourced Labels via Probabilistic Matrix Factorization.
HCOMP@AAAI
Hyun Joon Jung, Matthew Lease
2012 A* conf
Inferring missing relevance judgments from crowd workers via probabilistic matrix factorization.
SIGIR
Hyun Joon Jung, Matthew Lease
2012 — conf
Overview of the TREC 2012 Crowdsourcing Track.
TREC
Mark D. Smucker, Gabriella Kazai, Matthew Lease
2012 A* conf
Parallelizing ListNet training using spark.
SIGIR
Shilpa Shukla, Matthew Lease, Ambuj Tewari
2011 A* conf
Active learning to maximize accuracy vs. effort in interactive information retrieval.
SIGIR
Aibo Tian, Matthew Lease
2011 A conf
Crowdsourcing 101: putting the WSDM of crowds to work for you.
WSDM
Omar Alonso, Matthew Lease
2011 J jnl
Crowdsourcing for information retrieval.
SIGIR Forum
Matthew Lease, Emine Yilmaz
2011 A* conf
Crowdsourcing for information retrieval: principles, methods, and applications.
SIGIR
Omar Alonso, Matthew Lease
2011 A conf
Crowdsourcing for search and data mining.
WSDM
Vitor R. Carvalho, Matthew Lease, Emine Yilmaz
2011 J jnl
Crowdsourcing for search and data mining.
SIGIR Forum
Matthew Lease, Vitor R. Carvalho, Emine Yilmaz
2011 — conf
Crowdworker filtering with support vector machine.
ASIST
Hohyon Ryu, Matthew Lease
2011 — conf
Enabling trust in crowd labor relations through identity sharing.
ASIST
Jörn Klinger, Matthew Lease
2011 — conf
Improving Consensus Accuracy via Z-Score and Weighted Voting.
Human Computation
Hyun Joon Jung, Matthew Lease
2011 A* conf
Learning to rank from a noisy crowd.
SIGIR
Abhimanu Kumar, Matthew Lease
2011 — conf
Look before you leap: Legal pitfalls of crowdsourcing.
ASIST
Stephen M. Wolfson, Matthew Lease
2011 — conf
Mobile options for online public access catalogs.
iConference
Yongyi Zhou, Ramona Broussard, Matthew Lease
2011 — conf
On Quality Control and Machine Learning in Crowdsourcing.
Human Computation
Matthew Lease
2011 A conf
Supervised language modeling for temporal resolution of texts.
CIKM
Abhimanu Kumar, Matthew Lease, Jason Baldridge
2010 — —
Beyond keywords: finding information more accurately and easily using natural language.
Matthew Lease
2010 — conf
Crowdsourcing Document Relevance Assessment with Mechanical Turk.
Mturk@HLT-NAACL
Catherine Grady, Matthew Lease
2010 J jnl
Crowdsourcing for search evaluation.
SIGIR Forum
Vitor R. Carvalho, Matthew Lease, Emine Yilmaz
2010 — conf
Effective Term Weighting for Sentence Retrieval.
ECDL
Saeedeh Momtazi, Matthew Lease, Dietrich Klakow
2010 — conf
Mobile phone search for library catalogs.
ASIST
Ramona Broussard, Yongyi Zhou, Matthew Lease
2010 — conf
University of Texas mobile library search.
ASIST
Ramona Broussard, Yongyi Zhou, Matthew Lease
2009 A* conf
An improved markov random field model for supporting verbose queries.
SIGIR
Matthew Lease
2009 A conf
Regression Rank: Learning to Meet the Opportunity of Descriptive Queries.
ECIR
Matthew Lease, James Allan, W. Bruce Croft
2009 — conf
UMass Amherst and UT Austin @ the TREC 2009 Relevance Feedback Track.
TREC
Marc-Allen Cartright, Jangwon Seo, Matthew Lease
2008 — conf
Incorporating Relevance and Pseudo-relevance Feedback in the Markov Random Field Model.
TREC
Matthew Lease
2007 — conf
A Dirichlet-Smoothed Bigram Model for Retrieving Spontaneous Speech.
CLEF
Matthew Lease, Eugene Charniak
2007 — conf
Brown at CL-SR'07: Retrieving Conversational Speech in English and Czech.
CLEF (Working Notes)
Matthew Lease, Eugene Charniak
2007 — conf
Natural language processing for information retrieval: the time is ripe (again).
PIKM
Matthew Lease
2006 A* conf
A Look at Parsing and Its Applications.
AAAI
Matthew Lease, Eugene Charniak, Mark Johnson, David McClosky
2006 — conf
Early Deletion of Fillers In Processing Conversational Speech.
HLT-NAACL
Matthew Lease, Mark Johnson
2006 B conf
Linguistic Resources for Speech Parsing.
LREC
Ann Bies, Stephanie M. Strassel, Haejoong Lee, Kazuaki Maeda, Seth Kulick, Yang Liu, Mary P. Harper, Matthew Lease
2006 A* conf
PCFGs with Syntactic and Prosodic Indicators of Speech Repairs.
ACL
John Hale, Izhak Shafran, Lisa Yung, Bonnie J. Dorr, Mary P. Harper, Anna Krasnyanskaya, Matthew Lease, Yang Liu, Brian Roark, Matthew G. Snover, Robin Stewart
2006 J jnl
Recognizing disfluencies in conversational speech.
IEEE Trans. Speech Audio Process.
Matthew Lease, Mark Johnson, Eugene Charniak
2006 — conf
Reranking for Sentence Boundary Detection in Conversational Speech.
ICASSP (1)
Brian Roark, Yang Liu, Mary P. Harper, Robin Stewart, Matthew Lease, Matthew G. Snover, Izhak Shafran, Bonnie J. Dorr, John Hale, Anna Krasnyanskaya, Lisa Yung
2006 B conf
SParseval: Evaluation Metrics for Parsing Speech.
LREC
Brian Roark, Mary P. Harper, Eugene Charniak, Bonnie J. Dorr, Mark Johnson, Jeremy G. Kahn, Yang Liu, Mari Ostendorf, John Hale, Anna Krasnyanskaya, Matthew Lease, Izhak Shafran, Matthew G. Snover, Robin Stewart, Lisa Yung
2005 — conf
Effective Use of Prosody in Parsing Conversational Speech.
HLT/EMNLP
Jeremy G. Kahn, Matthew Lease, Eugene Charniak, Mark Johnson, Mari Ostendorf
2005 B conf
Parsing Biomedical Literature.
IJCNLP
Matthew Lease, Eugene Charniak
2005 — conf
Parsing and its applications for conversational speech.
ICASSP (5)
Matthew Lease, Eugene Charniak, Mark Johnson
2003 — conf
SmartElevator: Revitalizing A Legacy Device through Inexpensive Augmentation.
ICDCS Workshops
Matthew Lease, Guy Eddon
2002 — conf
Making Sensor Networks Practical with Robots.
Pervasive
Anthony LaMarca, Waylon Brunette, David Koizumi, Matthew Lease, Stefan B. Sigurdsson, Kevin Sikorski, Dieter Fox, Gaetano Borriello
2002 Misc conf
PlantCare: An Investigation in Practical Ubiquitous Systems.
UbiComp
Anthony LaMarca, Waylon Brunette, David Koizumi, Matthew Lease, Stefan B. Sigurdsson, Kevin Sikorski, Dieter Fox, Gaetano Borriello
1999 Misc conf
Anatomical information in radiation treatment planning.
AMIA
Ira J. Kalet, Jonn Wu, Matthew Lease, Mary M. Austin-Seymour, James F. Brinkley, Cornelius Rosse