Ben Carterette

157 papers A* 38A 21B 4C 1Misc 13Journal 32Unranked 41
YearRankTypeTitle / Venue / Authors
2025 — conf
ForTune: Running Offline Scenarios to Estimate Impact on Business Metrics.
KDD (1)
Georges Dupret, Konstantin Sozinov, Carmen Barcena Gonzalez, Ziggy Zacks, Amber Yuan, Ben Carterette, Manuel Mai, Andrey Gatash, Gwo Liang Lien, Shubham Bansal, Roberto Sanchis-Ojeda, Mounia Lalmas
2024 J jnl
Distributionally-Informed Recommender System Evaluation.
Trans. Recomm. Syst.
Michael D. Ekstrand, Ben Carterette, Fernando Diaz
2024 A* conf
Long-term Off-Policy Evaluation and Learning.
WWW
Yuta Saito, Himan Abdollahpouri, Jesse Anderton, Ben Carterette, Mounia Lalmas
2024 J jnl
Long-term Off-Policy Evaluation and Learning.
CoRR
Yuta Saito, Himan Abdollahpouri, Jesse Anderton, Ben Carterette, Mounia Lalmas
2024 A conf
PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapters.
CIKM
Azin Ghazimatin, Ekaterina Garmash, Gustavo Penha, Kristen Sheets, Martin Achenbach, Oguz Semerci, Remi Galvez, Marcus Tannenberg, Sahitya Mantravadi, Divya Narayanan, Ofeliya Kalaydzhyan, Douglas Cole, Ben Carterette, Ann Clifton, Paul N. Bennett, Claudia Hauff, Mounia Lalmas
2024 J jnl
PODTILE: Facilitating Podcast Episode Browsing with Auto-generated Chapters.
CoRR
Azin Ghazimatin, Ekaterina Garmash, Gustavo Penha, Kristen Sheets, Martin Achenbach, Oguz Semerci, Remi Galvez, Marcus Tannenberg, Sahitya Mantravadi, Divya Narayanan, Ofeliya Kalaydzhyan, Douglas Cole, Ben Carterette, Ann Clifton, Paul N. Bennett, Claudia Hauff, Mounia Lalmas
2023 Misc conf
A is for Adele: An Offline Evaluation Metric for Instant Search.
ICTIR
Negar Arabzadeh, Oleksandra Kmet, Ben Carterette, Charles L. A. Clarke, Claudia Hauff, Praveen Chandar
2023 J jnl
Distributionally-Informed Recommender System Evaluation.
CoRR
Michael D. Ekstrand, Ben Carterette, Fernando Diaz
2023 J jnl
Frontiers of Information Access Experimentation for Research and Education (Dagstuhl Seminar 23031).
Dagstuhl Reports
Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr, Guglielmo Faggioli
2023 A conf
Graph Learning for Exploratory Query Suggestions in an Instant Search System.
CIKM
Enrico Palumbo, Andreas Damianou, Alice Wang, Alva Liu, Ghazal Fazelnia, Francesco Fabbri, Rui Ferreira, Fabrizio Silvestri, Hugues Bouchard, Claudia Hauff, Mounia Lalmas, Ben Carterette, Praveen Chandar, David Nyhan
2023 J jnl
Report from Dagstuhl Seminar 23031: Frontiers of Information Access Experimentation for Research and Education.
CoRR
Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr
2023 J jnl
Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.
SIGIR Forum
Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr, Joeran Beel, Timo Breuer, Charles L. A. Clarke, Anita Crescenzi, Gianluca Demartini, Giorgio Maria Di Nunzio, Laura Dietz, Guglielmo Faggioli, Bruce Ferwerda, Maik Fröbe, Matthias Hagen, Allan Hanbury, Claudia Hauff, Dietmar Jannach, Noriko Kando, Evangelos Kanoulas, Bart P. Knijnenburg, Udo Kruschwitz, Meijie Li, Maria Maistro, Lien Michiels, Andrea Papenmeier, Martin Potthast, Paolo Rosso, Alan Said, Philipp Schaer, Christin Seifert, Damiano Spina, Benno Stein, Nava Tintarev, Julián Urbano, Henning Wachsmuth, Martijn C. Willemsen, Justin Zobel
2022 B conf
CHIIR Workshop on Audio Collection Human Interaction (AudioCHI 2022): http: //speechretrievalworkshop.github.io.
CHIIR
Gareth J. F. Jones, Maria Eskevich, Ben Carterette, Joana Correia, Rosie Jones, Jussi Karlgren, Ian Soboroff
2022 J jnl
Chair's Letter.
SIGIR Forum
Ben Carterette
2022 J jnl
Report on the 1st Workshop on Audio Collection Human Interaction (AudioCHI 2022) at CHIIR 2022.
SIGIR Forum
Gareth J. F. Jones, Maria Eskevich, Ben Carterette, Joana Correia, Rosie Jones, Jussi Karlgren, Ian Soboroff
2022 A* ed.
SIGIR '22: The 45th International ACM SIGIR Conference on Research and Development in Information Retrieval, Madrid, Spain, July 11 - 15, 2022
SIGIR
Enrique Amigó, Pablo Castells, Julio Gonzalo, Ben Carterette, J. Shane Culpepper, Gabriella Kazai
2022 A* conf
Using Survival Models to Estimate User Engagement in Online Experiments.
WWW
Praveen Chandar, Brian St. Thomas, Lucas Maystre, Vijay Pappu, Roberto Sanchis-Ojeda, Tiffany Wu, Ben Carterette, Mounia Lalmas, Tony Jebara
2021 J jnl
Chair's letter.
SIGIR Forum
Ben Carterette
2021 A* conf
Current Challenges and Future Directions in Podcast Information Access.
SIGIR
Rosie Jones, Hamed Zamani, Markus Schedl, Ching-Wei Chen, Sravana Reddy, Ann Clifton, Jussi Karlgren, Helia Hashemi, Aasish Pappu, Zahra Nazari, Longqi Yang, Oguz Semerci, Hugues Bouchard, Ben Carterette
2021 J jnl
Current Challenges and Future Directions in Podcast Information Access.
CoRR
Rosie Jones, Hamed Zamani, Markus Schedl, Ching-Wei Chen, Sravana Reddy, Ann Clifton, Jussi Karlgren, Helia Hashemi, Aasish Pappu, Zahra Nazari, Longqi Yang, Oguz Semerci, Hugues Bouchard, Ben Carterette
2021 A* conf
Estimation of Fair Ranking Metrics with Incomplete Judgments.
WWW
Ömer Kirnap, Fernando Diaz, Asia Biega, Michael D. Ekstrand, Ben Carterette, Emine Yilmaz
2021 J jnl
Estimation of Fair Ranking Metrics with Incomplete Judgments.
CoRR
Ömer Kirnap, Fernando Diaz, Asia Biega, Michael D. Ekstrand, Ben Carterette, Emine Yilmaz
2021 J jnl
How Am I Doing?: Evaluating Conversational Search Systems Offline.
ACM Trans. Inf. Syst.
Aldo Lipani, Ben Carterette, Emine Yilmaz
2021 J jnl
Model Selection for Production System via Automated Online Experiments.
CoRR
Zhenwen Dai, Praveen Chandar, Ghazal Fazelnia, Ben Carterette, Mounia Lalmas-Roelleke
2021 A* conf
Podcast Metadata and Content: Episode Relevance and Attractiveness in Ad Hoc Search.
SIGIR
Ben Carterette, Rosie Jones, Gareth J. F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff
2021 J jnl
Podcast Metadata and Content: Episode Relevance andAttractiveness in Ad Hoc Search.
CoRR
Ben Carterette, Rosie Jones, Gareth J. F. Jones, Maria Eskevich, Sravana Reddy, Ann Clifton, Yongze Yu, Jussi Karlgren, Ian Soboroff
2021 J jnl
TREC 2020 Podcasts Track Overview.
CoRR
Rosie Jones, Ben Carterette, Ann Clifton, Maria Eskevich, Gareth J. F. Jones, Jussi Karlgren, Aasish Pappu, Sravana Reddy, Yongze Yu
2021 — conf
TREC 2021 Podcasts Track Overview.
TREC
Jussi Karlgren, Rosie Jones, Ben Carterette, Ann Clifton, Edgar Tanaka, Maria Eskevich, Gareth J. F. Jones, Sravana Reddy
2021 — conf
Target-aware Aggregate Diversification in Recommendation.
UMAP (Adjunct Publication)
Himan Abdollahpouri, Jesse Anderton, Zahra Nazari, Ben Carterette
2020 B conf
100, 000 Podcasts: A Spoken English Document Corpus.
COLING
Ann Clifton, Sravana Reddy, Yongze Yu, Aasish Pappu, Rezvaneh Rezapour, Hamed R. Bonab, Maria Eskevich, Gareth J. F. Jones, Jussi Karlgren, Ben Carterette, Rosie Jones
2020 A* conf
Advances in Recommender Systems: From Multi-stakeholder Marketplaces to Automated RecSys.
KDD
Rishabh Mehrotra, Ben Carterette, Yong Li, Quanming Yao, Chen Gao, James T. Kwok, Qiang Yang, Isabelle Guyon
2020 A* conf
Bayesian Inferential Risk Evaluation On Multiple IR Systems.
SIGIR
Rodger Benham, Ben Carterette, J. Shane Culpepper, Alistair Moffat
2020 J jnl
Counterfactual Evaluation of Slate Recommendations with Sequential Reward Interactions.
CoRR
James McInerney, Brian Brost, Praveen Chandar, Rishabh Mehrotra, Ben Carterette
2020 A conf
Evaluating Stochastic Rankings with Expected Exposure.
CIKM
Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand, Asia J. Biega, Ben Carterette
2020 J jnl
Evaluating Stochastic Rankings with Expected Exposure.
CoRR
Fernando Diaz, Bhaskar Mitra, Michael D. Ekstrand, Asia J. Biega, Ben Carterette
2020 — conf
From Offline to Online Experimentation: Considerations from Experiences at Spotify.
NTCIR
Ben Carterette
2020 — conf
Leveraging Behavioral Heterogeneity Across Markets for Cross-Market Training of Recommender Systems.
WWW (Companion Volume)
Kevin Roitero, Ben Carterette, Rishabh Mehrotra, Mounia Lalmas
2020 A* conf
Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste.
SIGIR
Zahra Nazari, Christophe Charbuillet, Johan Pages, Martin Laurent, Denis Charrier, Briana Vecchione, Ben Carterette
2020 J jnl
Recommending Podcasts for Cold-Start Users Based on Music Listening and Taste.
CoRR
Zahra Nazari, Christophe Charbuillet, Johan Pages, Martin Laurent, Denis Charrier, Briana Vecchione, Ben Carterette
2020 J jnl
Report on the 2nd ACM SIGIR/SIGKDD Africa school on machine learning for data mining and search.
SIGIR Forum
Tanya Y. Berger-Wolf, Ben Carterette, Tamer Elsayed, C. Maria Keet, Fabrizio Sebastiani, Hussein Suleman
2020 — conf
TREC 2020 Podcasts Track Overview.
TREC
Rosie Jones, Ben Carterette, Ann Clifton, Jussi Karlgren, Aasish Pappu, Sravana Reddy, Yongze Yu, Maria Eskevich, Gareth J. F. Jones
2020 A* conf
The Engagement-Diversity Connection: Evidence from a Field Experiment on Spotify.
EC
David Holtz, Ben Carterette, Praveen Chandar, Zahra Nazari, Henriette Cramer, Sinan Aral
2020 J jnl
The Spotify Podcasts Dataset.
CoRR
Ann Clifton, Aasish Pappu, Sravana Reddy, Yongze Yu, Jussi Karlgren, Ben Carterette, Rosie Jones
2020 J jnl
Trajectory Based Podcast Recommendation.
CoRR
Greg Benton, Ghazal Fazelnia, Alice Wang, Ben Carterette
2019 Misc conf
From a User Model for Query Sessions to Session Rank Biased Precision (sRBP).
ICTIR
Aldo Lipani, Ben Carterette, Emine Yilmaz
2019 A conf
Offline Evaluation to Make Decisions About PlaylistRecommendation Algorithms.
WSDM
Alois Gruson, Praveen Chandar, Christophe Charbuillet, James McInerney, Samantha Hansen, Damien Tardieu, Ben Carterette
2019 Misc ed.
Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, ICTIR 2019, Santa Clara, CA, USA, October 2-5, 2019.
ICTIR
Yi Fang, Yi Zhang, James Allan, Krisztian Balog, Ben Carterette, Jiafeng Guo
2019 J jnl
Report on the 1st ACM SIGIR/SIGKDD Africa School on Machine Learning for Data Mining and Search.
SIGIR Forum
Ben Carterette, Hussein Suleman, Douglas W. Oard
2019 Misc conf
Statistical Significance Testing in Theory and in Practice.
ICTIR
Ben Carterette
2019 Misc conf
Taking Risks with Confidence.
ADCS
Rodger Benham, Ben Carterette, Alistair Moffat, J. Shane Culpepper
2018 A conf
Estimating Clickthrough Bias in the Cascade Model.
CIKM
Praveen Chandar, Ben Carterette
2018 C conf
Improving medical search tasks using learning to rank.
CIBCB
Mohammad Alsulmi, Ben Carterette
2018 A conf
Mixed methods for evaluating user satisfaction.
RecSys
Jean Garcia-Gathright, Christine Hosey, Brian St. Thomas, Ben Carterette, Fernando Diaz
2018 A* conf
Offline Comparative Evaluation with Incremental, Minimally-Invasive Online Feedback.
SIGIR
Ben Carterette, Praveen Chandar
2018 — ch.
Precision and Recall.
Encyclopedia of Database Systems (2nd ed.)
Ben Carterette
2018 — ch.
Search Engine Metrics.
Encyclopedia of Database Systems (2nd ed.)
Ben Carterette
2018 — ch.
Test Collection.
Encyclopedia of Database Systems (2nd ed.)
Ben Carterette
2017 A* conf
But Is It Statistically Significant?: Statistical Significance in IR Research, 1995-2014.
SIGIR
Ben Carterette
2017 A* conf
Statistical Significance Testing in Information Retrieval: Theory and Practice.
SIGIR
Ben Carterette
2017 — conf
TREC 2017 Tasks Track Overview.
TREC
Evangelos Kanoulas, Emine Yilmaz, Rishabh Mehrotra, Ben Carterette, Nick Craswell, Peter Bailey
2017 B conf
User Click Detection in Ideal Sessions.
CHIIR
Mustafa Zengin, Ben Carterette
2016 A* conf
Evaluating Retrieval over Sessions: The TREC Session Track 2011-2014.
SIGIR
Ben Carterette, Paul D. Clough, Mark M. Hall, Evangelos Kanoulas, Mark Sanderson
2016 B conf
Fusing Search Results from Possible Alternative Queries.
WI
Ashraf Bah, Ben Carterette
2016 — conf
Generating Pseudo Search History Data in the Absence of Real Search History.
DEXA (2)
Ashraf Bah, Ben Carterette
2016 — conf
Improving clinical case search using semantic based query reformulations.
BIBM
Mohammad Alsulmi, Ben Carterette
2016 J jnl
Information retrieval evaluation using test collections.
Inf. Retr. J.
Falk Scholer, Diane Kelly, Ben Carterette
2016 — conf
Learning to predict the performance of clinical queries using an integrated approach.
BIBM
Mohammad Alsulmi, Ben Carterette
2016 — conf
Overview of the TREC Tasks Track 2016.
TREC
Manisha Verma, Emine Yilmaz, Rishabh Mehrotra, Evangelos Kanoulas, Ben Carterette, Nick Craswell, Peter Bailey
2016 Misc conf
PDF: A Probabilistic Data Fusion Framework for Retrieval and Ranking.
ICTIR
Ashraf Bah Rabiou, Ben Carterette
2016 Misc ed.
Proceedings of the 2016 ACM on International Conference on the Theory of Information Retrieval, ICTIR 2016, Newark, DE, USA, September 12- 6, 2016
ICTIR
Ben Carterette, Hui Fang, Mounia Lalmas, Jian-Yun Nie
2016 — conf
Reformulate or Quit: Predicting User Abandonment in Ideal Sessions.
AIRS
Mustafa Zengin, Ben Carterette
2015 Misc conf
Bayesian Inference for Information Retrieval Evaluation.
ICTIR
Ben Carterette
2015 A* conf
Document Comprehensiveness and User Preferences in Novelty Search Tasks.
SIGIR
Ashraf Bah, Praveen Chandar, Ben Carterette
2015 Misc conf
Dynamic Test Collections for Retrieval Evaluation.
ICTIR
Ben Carterette, Ashraf Bah, Mustafa Zengin
2015 — conf
Improving Ranking and Robustness of Search Systems by Exploiting the Popularity of Documents.
AIRS
Ashraf Bah, Ben Carterette
2015 A conf
Learning User Preferences for Topically Similar Documents.
CIKM
Mustafa Zengin, Ben Carterette
2015 — conf
Overview of the TREC 2015 Tasks Track.
TREC
Emine Yilmaz, Manisha Verma, Rishabh Mehrotra, Evangelos Kanoulas, Ben Carterette, Nick Craswell
2015 Misc conf
Statistical Significance Testing in Information Retrieval: Theory and Practice.
ICTIR
Ben Carterette
2015 A* conf
The Best Published Result is Random: Sequential Testing and its Effect on Reported Effectiveness.
SIGIR
Ben Carterette
2014 — conf
Aggregating Results from Multiple Related Queries to Improve Web Search over Sessions.
AIRS
Ashraf Bah, Ben Carterette
2014 J jnl
Integrating information retrieval with distant supervision for Gene Ontology annotation.
Database J. Biol. Databases Curation
Dongqing Zhu, Dingcheng Li, Ben Carterette, Hongfang Liu
2014 — conf
Overview of the TREC 2014 Session Track.
TREC
Ben Carterette, Evangelos Kanoulas, Mark M. Hall, Paul D. Clough
2014 A ed.
Seventh ACM International Conference on Web Search and Data Mining, WSDM 2014, New York, NY, USA, February 24-28, 2014
WSDM
Ben Carterette, Fernando Diaz, Carlos Castillo, Donald Metzler
2014 A* conf
Statistical significance testing in information retrieval: theory and practice.
SIGIR
Ben Carterette
2014 — conf
Udel @ NTCIR-11 IMine Track.
NTCIR
Ashraf Bah, Ben Carterette, Praveen Chandar
2014 — conf
Udel @ NTCIR-11 MobileClick Track.
NTCIR
Ashraf Bah Rabiou, Ben Carterette
2014 — conf
University of Delaware at TREC 2014.
TREC
Ashraf Bah, Karankumar Sabhnani, Mustafa Zengin, Ben Carterette
2014 J jnl
Using large clinical corpora for query expansion in text-based cohort identification.
J. Biomed. Informatics
Dongqing Zhu, Stephen T. Wu, Ben Carterette, Hongfang Liu
2013 — conf
An Incremental Approach for MEDLINE MeSH Indexing.
BioASQ@CLEF
Dongqing Zhu, Dingcheng Li, Ben Carterette, Hongfang Liu
2013 A* conf
An adaptive evidence weighting method for medical record search.
SIGIR
Dongqing Zhu, Ben Carterette
2013 J jnl
An overview of the BioCreative 2012 Workshop Track III: interactive text mining task.
Database J. Biol. Databases Curation
Cecilia N. Arighi, Ben Carterette, K. Bretonnel Cohen, Martin Krallinger, W. John Wilbur, Petra Fey, Robert J. Dodson, Laurel Cooper, Ceri E. Van Slyke, Wasila M. Dahdul, Paula M. Mabee, Donghui Li, Bethany R. Harris, Marc Gillespie, Silvia Jimenez, Phoebe M. Roberts, Lisa Matthews, Kevin G. Becker, Harold J. Drabkin, Susan M. Bello, Luana Licata, Andrew Chatr-aryamontri, Mary L. Schaeffer, Julie Park, Melissa A. Haendel, Kimberly Van Auken, Yuling Li, Juancarlos Chan, Hans-Michael Müller, Hong Cui, James P. Balhoff, Chi-Yang Wu, Zhiyong Lu, Chih-Hsuan Wei, Catalina O. Tudor, Kalpana Raja, Suresh Subramani, Jeyakumar Natarajan, Juan Miguel Cejuela, Pratibha Dubey, Cathy H. Wu
2013 A* conf
Document features predicting assessor disagreement.
SIGIR
Praveen Chandar, William Webber, Ben Carterette
2013 — conf
Joint search in text and concept spaces for EMR-based cohort identification.
BIBM
Dongqing Zhu, Ben Carterette
2013 — conf
MayoClinicNLP-CORE: Semantic representations for textual similarity.
*SEM@NAACL-HLT
Stephen T. Wu, Dongqing Zhu, Ben Carterette, Hongfang Liu
2013 — conf
Overview of the TREC 2013 Session Track.
TREC
Ben Carterette, Ashraf Bah, Evangelos Kanoulas, Mark M. Hall, Paul D. Clough
2013 A* conf
Preference based evaluation measures for novelty and diversity.
SIGIR
Praveen Chandar, Ben Carterette
2013 Misc conf
Statistical Significance Testing in Information Retrieval: Theory and Practice.
ICTIR
Ben Carterette
2013 — conf
Using Discharge Summaries to Improve Information Retrieval in Clinical Domain.
CLEF (Working Notes)
Dongqing Zhu, Stephen T. Wu, James J. Masanz, Ben Carterette, Hongfang Liu
2012 A* conf
Advances on the development of evaluation measures.
SIGIR
Ben Carterette, Evangelos Kanoulas, Emine Yilmaz
2012 A conf
Alternative assessor disagreement and retrieval depth.
CIKM
William Webber, Praveen Chandar, Ben Carterette
2012 — conf
Combining multi-level evidence for medical record retrieval.
SHB
Dongqing Zhu, Ben Carterette
2012 — conf
Exploring Evidence Aggregation Methods and External Expansion Sources for Medical Record Search.
TREC
Dongqing Zhu, Ben Carterette
2012 — conf
Improving health records search using multiple query expansion collections.
BIBM
Dongqing Zhu, Ben Carterette
2012 A conf
Incorporating variability in user behavior into systems based evaluation.
CIKM
Ben Carterette, Evangelos Kanoulas, Emine Yilmaz
2012 — conf
Overview of the TREC 2012 Session Track.
TREC
Evangelos Kanoulas, Ben Carterette, Mark M. Hall, Paul D. Clough, Mark Sanderson
2012 — conf
Predicting baby feeding method from unstructured electronic health record data.
DTMBIO@CIKM
Ashwani Rao, Kristin Maiden, Ben Carterette, Deb Ehrenthal
2012 A* conf
Using PageRank to infer user preferences.
SIGIR
Praveen Chandar, Ben Carterette
2012 A* conf
Using preference judgments for novel document retrieval.
SIGIR
Praveen Chandar, Ben Carterette
2011 A conf
A Methodology for Evaluating Aggregated Search Results.
ECIR
Jaime Arguello, Fernando Diaz, Jamie Callan, Ben Carterette
2011 J jnl
An analysis of NP-completeness in novelty and diversity ranking.
Inf. Retr.
Ben Carterette
2011 A* conf
Evaluating multi-query sessions.
SIGIR
Evangelos Kanoulas, Ben Carterette, Paul D. Clough, Mark Sanderson
2011 — conf
Implicit Feedback and Document Filtering for Retrieval Over Query Sessions.
TREC
Ben Carterette, Praveen Chandar
2011 Misc conf
Model-Based Inference about IR Systems.
ICTIR
Ben Carterette
2011 — ch.
Overview of Information Retrieval Evaluation.
Current Challenges in Patent Information Retrieval
Ben Carterette, Ellen M. Voorhees
2011 — conf
Overview of the TREC 2011 Session Track.
TREC
Evangelos Kanoulas, Mark M. Hall, Paul D. Clough, Ben Carterette, Mark Sanderson
2011 J jnl
Report on the ECIR 2011 workshop on information retrieval over query sessions.
SIGIR Forum
Ben Carterette, Paul D. Clough, Evangelos Kanoulas, Mark Sanderson
2011 — conf
Simple Rank-Based Filtering for Microblog Retrieval: Implications for Evaluation and Test Collections.
TREC
Ben Carterette, Naveen Kumar, Ashwani Rao, Dongqing Zhu
2011 A conf
Simulating simple user behavior for system effectiveness evaluation.
CIKM
Ben Carterette, Evangelos Kanoulas, Emine Yilmaz
2011 A* conf
System effectiveness, user models, and user utility: a conceptual framework for investigation.
SIGIR
Ben Carterette
2011 — conf
Using Multiple External Collections for Query Expansion.
TREC
Dongqing Zhu, Ben Carterette
2011 A conf
Within-Document Term-Based Index Pruning with Statistical Hypothesis Testing.
ECIR
Sree Lekha Thota, Ben Carterette
2010 A* conf
Diversification of search results using webgraphs.
SIGIR
Praveen Chandar, Ben Carterette
2010 A* conf
Low cost evaluation in information retrieval.
SIGIR
Ben Carterette, Evangelos Kanoulas, Emine Yilmaz
2010 A conf
Measuring the reusability of test collections.
WSDM
Ben Carterette, Evgeniy Gabrilovich, Vanja Josifovski, Donald Metzler
2010 — conf
Overview of the TREC 2010 Session Track.
TREC
Evangelos Kanoulas, Paul D. Clough, Ben Carterette, Mark Sanderson
2010 A* conf
Reusable test collections through experimental design.
SIGIR
Ben Carterette, Evangelos Kanoulas, Virgiliu Pavlu, Hui Fang
2010 A* conf
The effect of assessor error on IR system evaluation.
SIGIR
Ben Carterette, Ian Soboroff
2009 — conf
Ad Hoc and Diversity Retrieval at the University of Delaware.
TREC
Praveen Chandar, Aparna Kailasam, Divya Muppaneni, Sree Lekha Thota, Ben Carterette
2009 A* conf
Agreement among statistical significance tests for information retrieval evaluation at varying sample sizes.
SIGIR
Mark D. Smucker, James Allan, Ben Carterette
2009 Misc conf
An Analysis of NP-Completeness in Novelty and Diversity Ranking.
ICTIR
Ben Carterette
2009 A conf
If I Had a Million Queries.
ECIR
Ben Carterette, Virgiliu Pavlu, Evangelos Kanoulas, Javed A. Aslam, James Allan
2009 — conf
Million Query Track 2009 Overview.
TREC
Ben Carterette, Virgiliu Pavlu, Hui Fang, Evangelos Kanoulas
2009 — conf
Minimal Test Collections for Relevance Feedback.
TREC
Ben Carterette, Praveen Chandar, Aparna Kailasam, Divya Muppaneni, Sree Lekha Thota
2009 A* conf
On rank correlation and the distance between rankings.
SIGIR
Ben Carterette
2009 — ch.
Precision and Recall.
Encyclopedia of Database Systems
Ben Carterette
2009 A conf
Probabilistic models of ranking novel documents for faceted topic retrieval.
CIKM
Ben Carterette, Praveen Chandar
2009 J jnl
Redundancy, diversity and interdependent document relevance.
SIGIR Forum
Filip Radlinski, Paul N. Bennett, Ben Carterette, Thorsten Joachims
2009 — ch.
Search Engine Metrics.
Encyclopedia of Database Systems
Ben Carterette
2009 — ch.
Test Collection.
Encyclopedia of Database Systems
Ben Carterette
2008 J jnl
Beyond binary relevance: preferences, diversity, and set-level judgments.
SIGIR Forum
Paul N. Bennett, Ben Carterette, Olivier Chapelle, Thorsten Joachims
2008 A* conf
Evaluation measures for preference judgments.
SIGIR
Ben Carterette, Paul N. Bennett
2008 A* conf
Evaluation over thousands of queries.
SIGIR
Ben Carterette, Virgiliu Pavlu, Evangelos Kanoulas, Javed A. Aslam, James Allan
2008 A conf
Here or There.
ECIR
Ben Carterette, Paul N. Bennett, David Maxwell Chickering, Susan T. Dumais
2008 — conf
Million Query Track 2008 Overview.
TREC
James Allan, Javed A. Aslam, Virgil Pavlu, Evangelos Kanoulas, Ben Carterette
2007 A conf
A comparison of statistical significance tests for information retrieval evaluation.
CIKM
Mark D. Smucker, James Allan, Ben Carterette
2007 — conf
Evaluating Search Engines by Modeling the Relationship Between Relevance and Clicks.
NIPS
Ben Carterette, Rosie Jones
2007 A conf
Hypothesis testing with incomplete relevance judgments.
CIKM
Ben Carterette, Mark D. Smucker
2007 — conf
Million Query Track 2007 Overview.
TREC
James Allan, Ben Carterette, Blagovest Dachev, Javed A. Aslam, Virgiliu Pavlu, Evangelos Kanoulas
2007 — conf
Research Methodology in Studies of Information Retrieval Evaluation.
RIAO
Ben Carterette, James Allan
2007 A* conf
Robust test collections for retrieval evaluation.
SIGIR
Ben Carterette
2007 A conf
Semiautomatic evaluation of retrieval systems using document similarities.
CIKM
Ben Carterette, James Allan
2006 A* conf
Learning a ranking from pairwise preferences.
SIGIR
Ben Carterette, Desislava Petkova
2006 A* conf
Minimal test collections for retrieval evaluation.
SIGIR
Ben Carterette, James Allan, Ramesh K. Sitaraman
2006 A* conf
N Semantic Classes are Harder than Two.
ACL
Ben Carterette, Rosie Jones, Wiley Greiner, Cory Barr
2005 J jnl
Comparing inverted files and signature files for searching a large lexicon.
Inf. Process. Manag.
Ben Carterette, Fazli Can
2005 A conf
Incremental test collections.
CIKM
Ben Carterette, James Allan
2005 A* conf
When will information retrieval be "good enough"?
SIGIR
James Allan, Ben Carterette, Joshua Lewis