How to measure the reproducibility of system-oriented IR experiments T Breuer, N Ferro, N Fuhr, M Maistro, T Sakai, P Schaer, I Soboroff Proceedings of the 43rd International ACM SIGIR Conference on Research and …, 2020 | 27 | 2020 |
Overview of lilas 2021–living labs for academic search P Schaer, T Breuer, LJ Castro, B Wolff, J Schaible, N Tavakolpoursaleh International Conference of the Cross-Language Evaluation Forum for European …, 2021 | 16 | 2021 |
STELLA: Towards a Framework for the Reproducibility of Online Search Experiments. T Breuer, P Schaer, N Tavakolpoursaleh, J Schaible, B Wolff, B Müller OSIRRC@ SIGIR 2409, 8-11, 2019 | 16 | 2019 |
repro_eval: A Python Interface to Reproducibility Measures of System-Oriented IR Experiments T Breuer, N Ferro, M Maistro, P Schaer Advances in Information Retrieval: 43rd European Conference on IR Research …, 2021 | 15 | 2021 |
Validating simulations of user query variants T Breuer, N Fuhr, P Schaer European Conference on Information Retrieval, 80-94, 2022 | 13 | 2022 |
A living lab architecture for reproducible shared task experimentation T Breuer, P Schaer Werner Hülsbusch 74, 348-362, 2021 | 10 | 2021 |
Evaluation Infrastructures for Academic Shared Tasks: Requirements and Concept Design for Search and Recommendation Scenarios J Schaible, T Breuer, N Tavakolpoursaleh, B Müller, B Wolff, P Schaer Datenbank-Spektrum 20 (1), 29-36, 2020 | 8 | 2020 |
ir_metadata: An Extensible Metadata Schema for IR Experiments T Breuer, J Keller, P Schaer Proceedings of the 45th International ACM SIGIR Conference on Research and …, 2022 | 7 | 2022 |
Replicability and Reproducibility of Automatic Routing Runs. T Breuer, P Schaer CLEF (Working Notes) 2380, 2019 | 7 | 2019 |
Relevance assessments, bibliometrics, and altmetrics: a quantitative study on PubMed and arXiv T Breuer, P Schaer, D Tunger Scientometrics 127 (5), 2455-2478, 2022 | 6 | 2022 |
Overview of LiLAS 2021-Living Labs for Academic Search (Extended Overview). P Schaer, T Breuer, LJ Castro, B Wolff, J Schaible, N Tavakolpoursaleh CLEF (Working Notes) 2936, 1668-1699, 2021 | 6 | 2021 |
Relations Between Relevance Assessments, Bibliometrics and Altmetrics. T Breuer, P Schaer, D Tunger BIR@ ECIR, 101-112, 2020 | 6 | 2020 |
An in-depth investigation on the behavior of measures to quantify reproducibility M Maistro, T Breuer, P Schaer, N Ferro Information Processing & Management 60 (3), 103332, 2023 | 5 | 2023 |
Dockerizing Automatic Routing Runs for The Open-Source IR Replicability Challenge (OSIRRC 2019). T Breuer, P Schaer OSIRRC@ SIGIR 2409, 31-35, 2019 | 4 | 2019 |
Simulating Users in Interactive Web Table Retrieval B Engelmann, T Breuer, P Schaer Proceedings of the 32nd ACM International Conference on Information and …, 2023 | 3 | 2023 |
Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval T Breuer, M Pest, P Schaer Experimental IR Meets Multilinguality, Multimodality, and Interaction: 12th …, 2021 | 3 | 2021 |
Reproducible Online Search Experiments T Breuer Advances in Information Retrieval: 42nd European Conference on IR Research …, 2020 | 3 | 2020 |
Context-Driven Interactive Query Simulations Based on Generative Large Language Models B Engelmann, T Breuer, JI Friese, P Schaer, N Fuhr European Conference on Information Retrieval, 173-188, 2024 | 2 | 2024 |
Validating synthetic usage data in living lab environments T Breuer, N Fuhr, P Schaer ACM Journal of Data and Information Quality 16 (1), 1-33, 2024 | 2 | 2024 |
Reproducible Information Retrieval Research: From Principled System-Oriented Evaluations Towards User-Oriented Experimentation T Breuer Dissertation, Duisburg, Essen, Universität Duisburg-Essen, 2023, 2023 | 2 | 2023 |