Mark D. Smucker

85 papers A* 23A 9B 7Misc 4Journal 14Unranked 26

Year	Rank	Type	Title / Venue / Authors
2026	J	`jnl`	Resources for Automated Evaluation of Assistive RAG Systems that Help Readers with News Trustworthiness Assessment. CoRR Dake Zhang, Mark D. Smucker, Charles L. A. Clarke
2025	A*	`conf`	Extending MovieLens-32M to Provide New Evaluation Objectives. SIGIR Mark D. Smucker, Houmaan Chamani
2025	J	`jnl`	Extending MovieLens-32M to Provide New Evaluation Objectives. CoRR Mark D. Smucker, Houmaan Chamani
2024	—	`conf`	Overview of the TREC 2024 Lateral Reading Track. TREC Dake Zhang, Mark D. Smucker, Charles L. A. Clarke
2023	A*	`conf`	A Preference Judgment Tool for Authoritative Assessment. SIGIR Mahsa Seifikar, Linh Nhi Phan Minh, Negar Arabzadeh, Charles L. A. Clarke, Mark D. Smucker
2022	A*	`conf`	Learning Trustworthy Web Sources to Derive Correct Answers and Reduce Health Misinformation in Search. SIGIR Dake Zhang, Amir Vakili Tahami, Mustafa Abualsaud, Mark D. Smucker
2022	B	`conf`	The Dark Side of Relevance: The Effect of Non-Relevant Results on Search Behavior. CHIIR Mustafa Abualsaud, Mark D. Smucker
2022	—	`conf`	UWaterlooMDS at the TREC 2022 Health Misinformation Track. TREC Amir Vakili Tahami, Dake Zhang, Mark D. Smucker
2021	J	`jnl`	Assessing Top- Preferences. ACM Trans. Inf. Syst. Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
2021	A*	`conf`	Evaluation Measures Based on Preference Graphs. SIGIR Charles L. A. Clarke, Chengxi Luo, Mark D. Smucker
2021	—	`conf`	Overview of the TREC 2021 Health Misinformation Track. TREC Charles L. A. Clarke, Maria Maistro, Mark D. Smucker
2021	—	`conf`	UWaterlooMDS at the TREC 2021 Health Misinformation Track. TREC Mustafa Abualsaud, Kamyar Ghajar, Linh Nhi Phan Minh, Dake Zhang, Irene Xiangyi Chen, Mark D. Smucker, Amir Vakili Tahami
2021	B	`conf`	Visualizing Searcher Gaze Patterns. CHIIR Mustafa Abualsaud, Mark D. Smucker, Charles L. A. Clarke
2020	B	`conf`	A Think-Aloud Study to Understand Factors Affecting Online Health Search. CHIIR Amira Ghenai, Mark D. Smucker, Charles L. A. Clarke
2020	J	`jnl`	Assessing top-k preferences. CoRR Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
2020	J	`jnl`	Evaluating sentence-level relevance feedback for high-recall information retrieval. Inf. Retr. J. Haotian Zhang, Gordon V. Cormack, Maura R. Grossman, Mark D. Smucker
2020	A	`conf`	Offline Evaluation by Maximum Similarity to an Ideal Ranking. CIKM Charles L. A. Clarke, Mark D. Smucker, Alexandra Vtyurina
2020	Misc	`conf`	Offline Evaluation without Gain. ICTIR Charles L. A. Clarke, Alexandra Vtyurina, Mark D. Smucker
2020	—	`conf`	Overview of the TREC 2020 Health Misinformation Track. TREC Charles L. A. Clarke, Saira Rizvi, Mark D. Smucker, Maria Maistro, Guido Zuccon
2019	A*	`conf`	Dynamic Sampling Meets Pooling. SIGIR Gordon V. Cormack, Haotian Zhang, Nimesh Ghelani, Mustafa Abualsaud, Mark D. Smucker, Maura R. Grossman, Shahin Rahbariasl, Amira Ghenai
2019	A	`conf`	Patterns of Search Result Examination: Query to First Action. CIKM Mustafa Abualsaud, Mark D. Smucker
2019	A*	`conf`	Time-Limits and Summaries for Faster Relevance Assessing. SIGIR Shahin Rahbariasl, Mark D. Smucker
2019	—	`conf`	UWaterlooMDS at the TREC 2019 Decision Track. TREC Mustafa Abualsaud, Fuat Can Beylunioglu, Mark D. Smucker, P. Robert Duimering
2018	B	`conf`	A Study of Immediate Requery Behavior in Search. CHIIR Haotian Zhang, Mustafa Abualsaud, Mark D. Smucker
2018	A*	`conf`	A System for Efficient High-Recall Retrieval. SIGIR Mustafa Abualsaud, Nimesh Ghelani, Haotian Zhang, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
2018	A	`conf`	Effective User Interaction for High-Recall Retrieval: Less is More. CIKM Haotian Zhang, Mustafa Abualsaud, Nimesh Ghelani, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
2018	J	`jnl`	Evaluating Sentence-Level Relevance Feedback for High-Recall Information Retrieval. CoRR Haotian Zhang, Gordon V. Cormack, Maura R. Grossman, Mark D. Smucker
2018	—	`conf`	Refresh Strategies in Continuous Active Learning. ProfS/KG4IR/Data:Search@SIGIR Nimesh Ghelani, Gordon V. Cormack, Mark D. Smucker
2018	J	`jnl`	Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018). SIGIR Forum J. Shane Culpepper, Fernando Diaz, Mark D. Smucker
2018	—	`conf`	UWaterlooMDS at the TREC 2018 Common Core Track. TREC Mustafa Abualsaud, Gordon V. Cormack, Nimesh Ghelani, Amira Ghenai, Maura R. Grossman, Shahin Rahbariasl, Haotian Zhang, Mark D. Smucker
2017	A*	`conf`	Automatically Extracting High-Quality Negative Examples for Answer Selection in Question Answering. SIGIR Haotian Zhang, Jinfeng Rao, Jimmy Lin, Mark D. Smucker
2017	J	`jnl`	Overview of Special Issue. SIGIR Forum James Allan, Nicholas J. Belkin, Paul N. Bennett, Jamie Callan, Charles L. A. Clarke, Fernando Diaz, Susan T. Dumais, Nicola Ferro, Donna Harman, Djoerd Hiemstra, Ian Ruthven, Tetsuya Sakai, Mark D. Smucker, Justin Zobel
2017	Misc	`conf`	The Positive and Negative Influence of Search Results on People's Decisions about the Efficacy of Medical Treatments. ICTIR Frances A. Pogacar, Amira Ghenai, Mark D. Smucker, Charles L. A. Clarke
2017	—	`conf`	UWaterlooMDS at the TREC 2017 Common Core Track. TREC Haotian Zhang, Mustafa Abualsaud, Nimesh Ghelani, Angshuman Ghosh, Mark D. Smucker, Gordon V. Cormack, Maura R. Grossman
2016	B	`conf`	Are Secondary Assessors Uncertain When They Disagree About Relevance Judgements? CHIIR Aiman Lafi Al-Harbi, Mark D. Smucker
2016	B	`conf`	Modeling Optimal Switching Behavior. CHIIR Mark D. Smucker, Charles L. A. Clarke
2016	A	`conf`	Optimizing Nugget Annotations with Active Learning. CIKM Gaurav Baruah, Haotian Zhang, Rakesh Guttikonda, Jimmy Lin, Mark D. Smucker, Olga Vechtomova
2016	A*	`conf`	Sampling Strategies and Active Learning for Volume Estimation. SIGIR Haotian Zhang, Jimmy Lin, Gordon V. Cormack, Mark D. Smucker
2015	A*	`conf`	Evaluating Streams of Evolving News Events. SIGIR Gaurav Baruah, Mark D. Smucker, Charles L. A. Clarke
2015	A*	`conf`	IR Evaluation: Modeling User Behavior for Measuring Effectiveness. SIGIR Charles L. A. Clarke, Mark D. Smucker, Emine Yilmaz
2015	—	`conf`	Lexical Comparison Between Wikipedia and Twitter Corpora by Using Word Embeddings. ACL (2) Luchen Tan, Haotian Zhang, Charles L. A. Clarke, Mark D. Smucker
2015	Misc	`conf`	Pooling for User-Oriented Evaluation Measures. ICTIR Gaurav Baruah, Adam Roegiest, Mark D. Smucker
2015	—	`conf`	WaterlooClarke: TREC 2015 Total Recall Track. TREC Haotian Zhang, Wu Lin, Yipeng Wang, Charles L. A. Clarke, Mark D. Smucker
2014	—	`conf`	A qualitative exploration of secondary assessor relevance judging behavior. IIiX Aiman Lafi Al-Harbi, Mark D. Smucker
2014	A*	`conf`	Mouse movement during relevance judging: implications for determining user attention. SIGIR Mark D. Smucker, Xiaoyu Sunny Guo, Andrew Toulis
2014	J	`jnl`	Report on the CIKM workshop on living labs for information retrieval evaluation. SIGIR Forum Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, Mark D. Smucker
2014	A*	`conf`	The effect of expanding relevance judgements with duplicates. SIGIR Gaurav Baruah, Adam Roegiest, Mark D. Smucker
2014	—	`conf`	Time well spent. IIiX Charles L. A. Clarke, Mark D. Smucker
2014	A	`conf`	Tolerance of Effectiveness Measures to Relevance Judging Errors. ECIR Le Li, Mark D. Smucker
2013	A	`conf`	CIKM 2013 workshop on living labs for information retrieval evaluation. CIKM Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, Mark D. Smucker
2013	J	`jnl`	HCIR 2013: the seventh international symposium on human-computer interaction and information retrieval. SIGIR Forum Robert Capra, Luanne Freund, Catherine L. Smith, Mark D. Smucker, Ryen W. White
2013	—	`conf`	Overview of the TREC 2013 Crowdsourcing Track. TREC Mark D. Smucker, Gabriella Kazai, Matthew Lease
2013	—	`ed.`	Proceedings of the 2013 workshop on Living labs for information retrieval evaluation, LivingLab@CIKM 2013, San Francisco, California, USA, November 1, 2013 LivingLab@CIKM Krisztian Balog, David Elsweiler, Evangelos Kanoulas, Liadh Kelly, Mark D. Smucker
2013	J	`jnl`	Report on the SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation (MUBE 2013). SIGIR Forum Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, Emine Yilmaz
2013	A*	`conf`	SIGIR 2013 workshop on modeling user behavior for information retrieval evaluation. SIGIR Charles L. A. Clarke, Luanne Freund, Mark D. Smucker, Emine Yilmaz
2012	—	`conf`	Human question answering performance using an interactive document retrieval system. IIiX Mark D. Smucker, James Allan, Blagovest Dachev
2012	—	`conf`	Modeling user variance in time-biased gain. HCIR Mark D. Smucker, Charles L. A. Clarke
2012	—	`conf`	Overview of the TREC 2012 Crowdsourcing Track. TREC Mark D. Smucker, Gabriella Kazai, Matthew Lease
2012	A	`conf`	Stochastic simulation of time-biased gain. CIKM Mark D. Smucker, Charles L. A. Clarke
2012	—	`conf`	The Fault, Dear Researchers, is not in Cranfield, But in our Metrics, that they are Unrealistic. EuroHCIR Mark D. Smucker, Charles L. A. Clarke
2012	A*	`conf`	Time to judge relevance as an indicator of assessor error. SIGIR Mark D. Smucker, Chandra Prakash Jethani
2012	A*	`conf`	Time-based calibration of effectiveness measures. SIGIR Mark D. Smucker, Charles L. A. Clarke
2011	—	`conf`	Crowdsourcing with a Crowd of One and Other TREC 2011 Crowdsourcing and Web Track Experiments. TREC Mark D. Smucker
2011	J	`jnl`	Efficient and effective spam filtering and re-ranking for large web datasets. Inf. Retr. Gordon V. Cormack, Mark D. Smucker, Charles L. A. Clarke
2011	—	`ch.`	Information representation. Interactive Information Seeking, Behaviour and Retrieval Mark D. Smucker
2011	A*	`conf`	Measuring assessor accuracy: a comparison of nist assessors and user study participants. SIGIR Mark D. Smucker, Chandra Prakash Jethani
2010	J	`jnl`	Efficient and Effective Spam Filtering and Re-ranking for Large Web Datasets CoRR Gordon V. Cormack, Mark D. Smucker, Charles L. A. Clarke
2010	A*	`conf`	Human performance and retrieval precision revisited. SIGIR Mark D. Smucker, Chandra Prakash Jethani
2010	J	`jnl`	Report on the SIGIR 2010 workshop on the simulation of interaction. SIGIR Forum Leif Azzopardi, Kalervo Järvelin, Jaap Kamps, Mark D. Smucker
2010	—	`conf`	University of Waterloo at TREC 2010: Legal Interactive. TREC Mark D. Smucker, Charles L. A. Clarke, Gordon V. Cormack, Olga Vechtomova
2009	Misc	`conf`	A New Measure of the Cluster Hypothesis. ICTIR Mark D. Smucker, James Allan
2009	A*	`conf`	Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes. SIGIR Mark D. Smucker, James Allan, Ben Carterette
2009	—	`conf`	Experiments with ClueWeb09: Relevance Feedback and Web Tracks. TREC Mark D. Smucker, Charles L. A. Clarke, Gordon V. Cormack
2008	A*	`conf`	How do users find things with PubMed?: towards automatic utility evaluation with user simulations. SIGIR Jimmy Lin, Mark D. Smucker
2008	—	`conf`	InterNano: e-Science for the Nanomanufacturing Community. eScience Rebecca Reznik-Zellen, Bob Stevens, Michael Thorn, Jeff Morse, Mark D. Smucker, James Allan, David M. Mimno, Andrew McCallum, Mark Tuominen
2007	A	`conf`	A comparison of statistical significance tests for information retrieval evaluation. CIKM Mark D. Smucker, James Allan, Ben Carterette
2007	A	`conf`	Hypothesis testing with incomplete relevance judgments. CIKM Ben Carterette, Mark D. Smucker
2007	—	`conf`	UMass Complex Interactive Question Answering (ciQA) 2007: Human Performance as Question Answerers. TREC Mark D. Smucker, James Allan, Blagovest Dachev
2007	A*	`conf`	Using similarity links as shortcuts to relevant web pages. SIGIR Mark D. Smucker, James Allan
2006	A*	`conf`	Find-similar: similarity browsing as a search tool. SIGIR Mark D. Smucker, James Allan
2006	A*	`conf`	Lightening the load of document smoothing for better language modeling retrieval. SIGIR Mark D. Smucker, James Allan
2006	—	`conf`	UMass Genomics 2006: Query-Biased Pseudo Relevance Feedback. TREC Mark D. Smucker
2004	—	`conf`	UMass at TREC 2004: Novelty and HARD. TREC Nasreen Abdul Jaleel, James Allan, W. Bruce Croft, Fernando Diaz, Leah S. Larkey, Xiaoyan Li, Mark D. Smucker, Courtney Wade
1999	B	`conf`	Graph based genetic algorithms. CEC Dan Ashlock, Mark D. Smucker, John Walker
1995	—	`conf`	Iterated Prisoner's Dilemma with Choice and Refusal of Partners: Evolutionary Results. ECAL E. Ann Stanley, Dan Ashlock, Mark D. Smucker