Timo Breuer

64 papers A* 6A 2C 1Misc 1Journal 32Unranked 21
YearRankTypeTitle / Venue / Authors
2026 — conf
Evaluating Information Retrieval Models Along Time: The LongEval Lab at CLEF 2026.
ECIR (4)
Timo Breuer, Matteo Cancellieri, Alaa El-Ebshihy, Maik Fröbe, Petra Galuscáková, Lorraine Goeuriot, Gabriel Iturra-Bocaz, Jüri Keller, Petr Knoth, Andreas Konstantin Kruff, Philippe Mulhem, Florina Piroi, David Pride, Philipp Schaer, Didier Schwab
2026 — conf
Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction.
ECIR (4)
Andreas Konstantin Kruff, Christin Katharina Kreutz, Timo Breuer, Philipp Schaer, Krisztian Balog
2025 A conf
"We Share Our Code Online": Why This Is Not Enough to Ensure Reproducibility and Progress in Recommender Systems Research.
RecSys
Faisal Shehzad, Timo Breuer, Maria Maistro, Dietmar Jannach
2025 J jnl
Conversational Agents: A Framework for Evaluation (CAFE) (Dagstuhl Perspectives Workshop 24352).
Dagstuhl Manifestos
Christine Bauer, Li Chen, Nicola Ferro, Norbert Fuhr, Avishek Anand, Timo Breuer, Guglielmo Faggioli, Ophir Frieder, Hideo Joho, Jussi Karlgren, Johannes Kiesel, Bart P. Knijnenburg, Aldo Lipani, Lien Michiels, Andrea Papenmeier, Maria Soledad Pera, Mark Sanderson, Scott Sanner, Benno Stein, Johanne R. Trippas, Karin Verspoor, Martijn C. Willemsen
2025 A* conf
Evaluating Contrastive Feedback for Effective User Simulations.
SIGIR
Andreas Konstantin Kruff, Timo Breuer, Philipp Schaer
2025 J jnl
Evaluating Contrastive Feedback for Effective User Simulations.
CoRR
Andreas Konstantin Kruff, Timo Breuer, Philipp Schaer
2025 J jnl
Large Language Models for Information Retrieval: Challenges and Chances.
Datenbank-Spektrum
Timo Breuer, Sameh Frihat, Norbert Fuhr, Dirk Lewandowski, Philipp Schaer, Ralf Schenkel
2025 J jnl
Manifesto from Dagstuhl Perspectives Workshop 24352 - Conversational Agents: A Framework for Evaluation (CAFE).
CoRR
Christine Bauer, Li Chen, Nicola Ferro, Norbert Fuhr, Avishek Anand, Timo Breuer, Guglielmo Faggioli, Ophir Frieder, Hideo Joho, Jussi Karlgren, Johannes Kiesel, Bart P. Knijnenburg, Aldo Lipani, Lien Michiels, Andrea Papenmeier, Maria Soledad Pera, Mark Sanderson, Scott Sanner, Benno Stein, Johanne R. Trippas, Karin Verspoor, Martijn C. Willemsen
2025 J jnl
Report on the Second Workshop on Simulations for Information Access (Sim4IA 2025) at SIGIR 2025.
SIGIR Forum
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer, Andreas Kruff, Mohammad Aliannejadi, Christine Bauer, Nolwenn Bernard, Nicola Ferro, Marcel Gohsen, Nurul Lubis, Saber Zerhoudi
2025 A* conf
Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025).
SIGIR
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer, Andreas Konstantin Kruff
2025 J jnl
Second SIGIR Workshop on Simulations for Information Access (Sim4IA 2025).
CoRR
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer, Andreas Konstantin Kruff
2025 J jnl
Sim4IA-Bench: A User Simulation Benchmark Suite for Next Query and Utterance Prediction.
CoRR
Andreas Konstantin Kruff, Christin Katharina Kreutz, Timo Breuer, Philipp Schaer, Krisztian Balog
2025 J jnl
User Simulation in Practice: Lessons Learned from Three Shared Tasks.
SIGIR Forum
Marcel Gohsen, Zahra Abbasiantaeb, Mohammad Aliannejadi, Krisztian Balog, Timo Breuer, Jeffrey Dalton, Maik Fröbe, Christin Katharina Kreutz, Andreas Kruff, Simon Lupart, Nailia Mirzakhmedova, Harrisen Scells, Philipp Schaer, Benno Stein, Johannes Kiesel
2024 A* conf
Browsing and Searching Metadata of TREC.
SIGIR
Timo Breuer, Ellen M. Voorhees, Ian Soboroff
2024 — conf
Context-Driven Interactive Query Simulations Based on Generative Large Language Models.
ECIR (2)
Björn Engelmann, Timo Breuer, Jana Isabelle Friese, Philipp Schaer, Norbert Fuhr
2024 — conf
Data Fusion of Synthetic Query Variants With Generative Large Language Models.
SIGIR-AP
Timo Breuer
2024 J jnl
Data Fusion of Synthetic Query Variants With Generative Large Language Models.
CoRR
Timo Breuer
2024 Misc conf
Evaluation of Temporal Change in IR Test Collections.
ICTIR
Jüri Keller, Timo Breuer, Philipp Schaer
2024 J jnl
Evaluation of Temporal Change in IR Test Collections.
CoRR
Jüri Keller, Timo Breuer, Philipp Schaer
2024 — conf
Leveraging Prior Relevance Signals in Web Search.
CLEF (Working Notes)
Jüri Keller, Timo Breuer, Philipp Schaer
2024 J jnl
Ranking Narrative Query Graphs for Biomedical Document Retrieval (Technical Report).
CoRR
Hermann Kroll, Pascal Sackhoff, Timo Breuer, Ralf Schenkel, Wolf-Tilo Balke
2024 — conf
Replicability Measures for Longitudinal Information Retrieval Evaluation.
CLEF (1)
Jüri Keller, Timo Breuer, Philipp Schaer
2024 J jnl
Replicability Measures for Longitudinal Information Retrieval Evaluation.
CoRR
Jüri Keller, Timo Breuer, Philipp Schaer
2024 J jnl
Report on the 1st Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024.
SIGIR Forum
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji, Gareth J. F. Jones, Jüri Keller, Jiqun Liu, Martin Mladenov, Gabriella Pasi, Johanne R. Trippas, Xi Wang, Saber Zerhoudi, ChengXiang Zhai
2024 J jnl
Report on the Workshop on Simulations for Information Access (Sim4IA 2024) at SIGIR 2024.
CoRR
Timo Breuer, Christin Katharina Kreutz, Norbert Fuhr, Krisztian Balog, Philipp Schaer, Nolwenn Bernard, Ingo Frommholz, Marcel Gohsen, Kaixin Ji, Gareth J. F. Jones, Jüri Keller, Jiqun Liu, Martin Mladenov, Gabriella Pasi, Johanne R. Trippas, Xi Wang, Saber Zerhoudi, ChengXiang Zhai
2024 A* conf
SIGIR 2024 Workshop on Simulations for Information Access (Sim4IA 2024).
SIGIR
Philipp Schaer, Christin Katharina Kreutz, Krisztian Balog, Timo Breuer, Norbert Fuhr
2024 — conf
SimIIR 3: A Framework for the Simulation of Interactive and Conversational Information Retrieval.
SIGIR-AP
Leif Azzopardi, Timo Breuer, Björn Engelmann, Christin Kreutz, Sean MacAvaney, David Maxwell, Andrew Parry, Adam Roegiest, Xi Wang, Saber Zerhoudi
2024 — conf
The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs.
CLEF (Working Notes)
Anh Thu Maria Bui, Saskia Felizitas Brech, Natalie Hußfeldt, Tobias Jennert, Melanie Ullrich, Timo Breuer, Narjes Nikzad-Khasmakhi, Philipp Schaer
2024 J jnl
The Two Sides of the Coin: Hallucination Generation and Detection with LLMs as Evaluators for LLMs.
CoRR
Anh Thu Maria Bui, Saskia Felizitas Brech, Natalie Hußfeldt, Tobias Jennert, Melanie Ullrich, Timo Breuer, Narjes Nikzad-Khasmakhi, Philipp Schaer
2024 — conf
Toward Evaluating the Reproducibility of Information Retrieval Systems with Simulated Users.
ACM-REP
Timo Breuer, Maria Maistro
2024 J jnl
Validating Synthetic Usage Data in Living Lab Environments.
ACM J. Data Inf. Qual.
Timo Breuer, Norbert Fuhr, Philipp Schaer
2023 J jnl
An in-depth investigation on the behavior of measures to quantify reproducibility.
Inf. Process. Manag.
Maria Maistro, Timo Breuer, Philipp Schaer, Nicola Ferro
2023 — conf
Bibliometric Data Fusion for Biomedical Information Retrieval.
JCDL
Timo Breuer, Christin Katharina Kreutz, Philipp Schaer, Dirk Tunger
2023 J jnl
Bibliometric Data Fusion for Biomedical Information Retrieval.
CoRR
Timo Breuer, Christin Katharina Kreutz, Philipp Schaer, Dirk Tunger
2023 J jnl
Context-Driven Interactive Query Simulations Based on Generative Large Language Models.
CoRR
Björn Engelmann, Timo Breuer, Jana Isabelle Friese, Philipp Schaer, Norbert Fuhr
2023 — conf
Evaluating Temporal Persistence Using Replicability Measures.
CLEF (Working Notes)
Jüri Keller, Timo Breuer, Philipp Schaer
2023 J jnl
Evaluating Temporal Persistence Using Replicability Measures.
CoRR
Jüri Keller, Timo Breuer, Philipp Schaer
2023 J jnl
Report on the Dagstuhl Seminar on Frontiers of Information Access Experimentation for Research and Education.
SIGIR Forum
Christine Bauer, Ben Carterette, Nicola Ferro, Norbert Fuhr, Joeran Beel, Timo Breuer, Charles L. A. Clarke, Anita Crescenzi, Gianluca Demartini, Giorgio Maria Di Nunzio, Laura Dietz, Guglielmo Faggioli, Bruce Ferwerda, Maik Fröbe, Matthias Hagen, Allan Hanbury, Claudia Hauff, Dietmar Jannach, Noriko Kando, Evangelos Kanoulas, Bart P. Knijnenburg, Udo Kruschwitz, Meijie Li, Maria Maistro, Lien Michiels, Andrea Papenmeier, Martin Potthast, Paolo Rosso, Alan Said, Philipp Schaer, Christin Seifert, Damiano Spina, Benno Stein, Nava Tintarev, Julián Urbano, Henning Wachsmuth, Martijn C. Willemsen, Justin Zobel
2023 — —
Reproducible Information Retrieval Research: From Principled System-Oriented Evaluations Towards User-Oriented Experimentation.
Timo Breuer
2023 A conf
Simulating Users in Interactive Web Table Retrieval.
CIKM
Björn Engelmann, Timo Breuer, Philipp Schaer
2023 J jnl
Simulating Users in Interactive Web Table Retrieval.
CoRR
Björn Engelmann, Timo Breuer, Philipp Schaer
2023 J jnl
Validating Synthetic Usage Data in Living Lab Environments.
CoRR
Timo Breuer, Norbert Fuhr, Philipp Schaer
2022 J jnl
Evaluating Elements of Web-based Data Enrichment for Pseudo-Relevance Feedback Retrieval.
CoRR
Timo Breuer, Melanie Pest, Philipp Schaer
2022 J jnl
Online Information Retrieval Evaluation using the STELLA Framework.
CoRR
Timo Breuer, Narges Tavakolpoursaleh, Johann Schaible, Daniel Hienert, Philipp Schaer, Leyla Jael Castro
2022 J jnl
Overview of LiLAS 2021 - Living Labs for Academic Search.
CoRR
Philipp Schaer, Timo Breuer, Leyla Jael Castro, Benjamin Wolff, Johann Schaible, Narges Tavakolpoursaleh
2022 J jnl
Relevance assessments, bibliometrics, and altmetrics: a quantitative study on PubMed and arXiv.
Scientometrics
Timo Breuer, Philipp Schaer, Dirk Tunger
2022 — conf
Validating Simulations of User Query Variants.
ECIR (1)
Timo Breuer, Norbert Fuhr, Philipp Schaer
2022 J jnl
Validating Simulations of User Query Variants.
CoRR
Timo Breuer, Norbert Fuhr, Philipp Schaer
2022 A* conf
ir_metadata: An Extensible Metadata Schema for IR Experiments.
SIGIR
Timo Breuer, Jüri Keller, Philipp Schaer
2022 J jnl
ir_metadata: An Extensible Metadata Schema for IR Experiments.
CoRR
Timo Breuer, Jüri Keller, Philipp Schaer
2022 J jnl
repro_eval: A Python Interface to Reproducibility Measures of System-oriented IR Experiments.
CoRR
Timo Breuer, Nicola Ferro, Maria Maistro, Philipp Schaer
2021 C conf
A Living Lab Architecture for Reproducible Shared Task Experimentation.
ISI
Timo Breuer, Philipp Schaer
2021 — conf
Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval.
CLEF
Timo Breuer, Melanie Pest, Philipp Schaer
2021 — conf
Overview of LiLAS 2021 - Living Labs for Academic Search (Extended Overview).
CLEF (Working Notes)
Philipp Schaer, Timo Breuer, Leyla Jael Castro, Benjamin Wolff, Johann Schaible, Narges Tavakolpoursaleh
2021 — conf
Overview of LiLAS 2021 - Living Labs for Academic Search.
CLEF
Philipp Schaer, Timo Breuer, Leyla Jael Castro, Benjamin Wolff, Johann Schaible, Narges Tavakolpoursaleh
2021 — conf
repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments.
ECIR (2)
Timo Breuer, Nicola Ferro, Maria Maistro, Philipp Schaer
2020 J jnl
Evaluation Infrastructures for Academic Shared Tasks.
Datenbank-Spektrum
Johann Schaible, Timo Breuer, Narges Tavakolpoursaleh, Bernd Müller, Benjamin Wolff, Philipp Schaer
2020 A* conf
How to Measure the Reproducibility of System-oriented IR Experiments.
SIGIR
Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff
2020 J jnl
How to Measure the Reproducibility of System-oriented IR Experiments.
CoRR
Timo Breuer, Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Philipp Schaer, Ian Soboroff
2020 — conf
Relations Between Relevance Assessments, Bibliometrics and Altmetrics.
BIR@ECIR
Timo Breuer, Philipp Schaer, Dirk Tunger
2020 — conf
Reproducible Online Search Experiments.
ECIR (2)
Timo Breuer
2019 — conf
Dockerizing Automatic Routing Runs for The Open-Source IR Replicability Challenge (OSIRRC 2019).
OSIRRC@SIGIR
Timo Breuer, Philipp Schaer
2019 — conf
Replicability and Reproducibility of Automatic Routing Runs.
CLEF (Working Notes)
Timo Breuer, Philipp Schaer
2019 — conf
STELLA: Towards a Framework for the Reproducibility of Online Search Experiments.
OSIRRC@SIGIR
Timo Breuer, Philipp Schaer, Narges Tavakolpoursaleh, Johann Schaible, Benjamin Wolff, Bernd Müller