Assessing efficiency–effectiveness tradeoffs in multi-stage retrieval systems without using relevance judgments

Charles L. A. Clarke, J. Shane Culpepper, Alistair Moffat

Type: Article

Publication Date: 2016-03-09

Citations: 30

DOI: https://doi.org/10.1007/s10791-016-9279-1

View Publication

Download PDF

Locations

arXiv (Cornell University) - View - PDF
Minerva Access (University of Melbourne) - View - PDF
Information Retrieval - View

Similar Works

Action	Title	Year	Authors
+	Assessing Efficiency-Effectiveness Tradeoffs in Multi-Stage Retrieval Systems Without Using Relevance Judgments	2015	Charles L. A. Clarke J. Shane Culpepper Alistair Moffat
+	Assessing Efficiency-Effectiveness Tradeoffs in Multi-Stage Retrieval Systems Without Using Relevance Judgments	2015	Charles L. A. Clarke J. Shane Culpepper Alistair Moffat
+	Dynamic Trade-Off Prediction in Multi-Stage Retrieval Systems	2016	J. Shane Culpepper Charles L. A. Clarke Jimmy Lin
+ PDF Chat	Predicting relevance based on assessor disagreement: analysis and practical applications for search evaluation	2015	Thomas Demeester Robin Aly Djoerd Hiemstra Dong Nguyen Chris Develder
+ PDF Chat	Evaluating Elements of Web-Based Data Enrichment for Pseudo-relevance Feedback Retrieval	2021	Timo Breuer Melanie Pest Philipp Schaer
+	Streamlining Evaluation with ir-measures	2021	Sean MacAvaney Craig Macdonald Iadh Ounis
+ PDF Chat	BIRCO: A Benchmark of Information Retrieval Tasks with Complex Objectives	2024	Xiaoyue Wang Jianyou Wang Weili Cao Kaicheng Wang Ramamohan Paturi Leon Bergen
+	Increasing the effectiveness of system-based evaluation for information retrieval systems / Prabha Rajagopal	2018	Prabha Rajagopal
+ PDF Chat	A Comparison of Performance Measures via Online Search	2012	Joan Boyar Kim S. Larsen Abyayananda Maiti
+ PDF Chat	Information Retrieval: Recent Advances and Beyond	2023	Kailash Hambarde Hugo Proença
+ PDF Chat	Intelligent topic selection for low-cost information retrieval evaluation: A New perspective on deep vs. shallow judging	2017	Mücahid Kutlu Tamer Elsayed Matthew Lease
+ PDF Chat	Evaluating sentence-level relevance feedback for high-recall information retrieval	2019	Haotian Zhang Gordon V. Cormack Maura R. Grossman Mark D. Smucker
+ PDF Chat	Towards Reliable Testing for Multiple Information Retrieval System Comparisons	2025	David Otero Javier Parapar Álvaro Barreiro
+	simIReff: Stochastic Simulation for Information Retrieval Evaluation: Effectiveness Scores	2018	Julián Urbano
+ PDF Chat	Investigating Bell Inequalities for Multidimensional Relevance Judgments in Information Retrieval	2019	Sagar Uprety Dimitris Gkoumas Dawei Song
+	Correlation and Prediction of Evaluation Metrics in Information Retrieval	2018	Mücahid Kutlu Vivek Khetan Matthew Lease
+ PDF Chat	Query Driven Algorithm Selection in Early Stage Retrieval	2018	Joel Mackenzie J. Shane Culpepper Roi Blanco Matt Crane Charles L. A. Clarke Jimmy Lin
+ PDF Chat	ASPIRE: Assistive System for Performance Evaluation in IR	2024	Georgios Peikos Wojciech Kusa Symeon Symeonidis
+ PDF Chat	Performance Evaluation in Multimedia Retrieval	2024	Loris Sauter Ralph Gasser Heiko Schuldt Abraham Bernstein Luca Rossetto
+ PDF Chat	A Formal Account of Effectiveness Evaluation and Ranking Fusion	2018	Enrique Amigó Fernando Giner Stefano Mizzaro Damiano Spina

Works That Cite This (12)

Action	Title	Year	Authors
+ PDF Chat	Efficient and Effective Tail Latency Minimization in Multi-Stage Retrieval Systems.	2017	Joel Mackenzie J. Shane Culpepper Roi Blanco Matt Crane Charles L. A. Clarke Jimmy Lin
+ PDF Chat	Query Driven Algorithm Selection in Early Stage Retrieval	2018	Joel Mackenzie J. Shane Culpepper Roi Blanco Matt Crane Charles L. A. Clarke Jimmy Lin
+ PDF Chat	Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting	2021	Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan‐Ju Wang Jimmy Lin
+ PDF Chat	Pretrained Transformers for Text Ranking: BERT and Beyond	2021	Jimmy Lin Rodrigo Nogueira Andrew Yates
+ PDF Chat	Anytime Ranking on Document-Ordered Indexes	2021	Joel Mackenzie Matthias Petri Alistair Moffat
+ PDF Chat	The Potential of Learned Index Structures for Index Compression	2018	Harrie Oosterhuis J. Shane Culpepper Maarten de Rijke
+	Anytime Ranking on Document-Ordered Indexes	2021	Joel Mackenzie Matthias Petri Alistair Moffat
+ PDF Chat	Semantic Ranking for Automated Adversarial Technique Annotation in Security Text	2024	Udesh Kumarasinghe Ahmed Lekssays Hüsrev Taha Sencar Sabri Boughorbel Charitha Elvitigala Preslav Nakov
+	Query Reformulation using Query History for Passage Retrieval in Conversational Search	2020	Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan‐Ju Wang Jimmy Lin
+	Multi-Stage Conversational Passage Retrieval: An Approach to Fusing Term Importance Estimation and Neural Query Rewriting	2020	Sheng-Chieh Lin Jheng-Hong Yang Rodrigo Nogueira Ming-Feng Tsai Chuan‐Ju Wang Jimmy Lin

Works Cited by This (3)

Action	Title	Year	Authors
+ PDF Chat	A Family of Rank Similarity Measures Based on Maximized Effectiveness Difference	2015	Luchen Tan Charles L. A. Clarke
+ PDF Chat	Efficient and effective spam filtering and re-ranking for large web datasets	2011	Gordon V. Cormack Mark D. Smucker Charles L. A. Clarke
+ PDF Chat	Decoding billions of integers per second through vectorization	2013	Daniel Lemire Leonid Boytsov