Numbers Matter! Bringing Quantity-awareness to Retrieval Systems (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Quantitative information is important for understanding documents and interpreting them. |
| Approach: | They propose two quantity-aware ranking techniques that rank both quantity and textual content . they use available retrieval systems to incorporate quantity information into queries . |
| Outcome: | The proposed methods can rank both quantity and textual content, either jointly or independently. |
Similar Papers
Dense Retrieval with Quantity Comparison Intent (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing sparse and dense retrieval systems fragment numerals and units that express quantities in arbitrary ways. |
| Approach: | They propose a dense retrieval system built around a density multi-vector index . they propose eliciting and exploiting quantities and associated comparison intents . |
| Outcome: | The proposed system is faster and more accurate than popular PLMs on two public and one proprietary e-commerce benchmarks. |
Moving Beyond Downstream Task Accuracy for Information Retrieval Benchmarking (2023.findings-acl)
Copied to clipboard
Keshav Santhanam, Jon Saad-Falcon, Martin Franz, Omar Khattab, Avi Sil, Radu Florian, Md Arafat Sultan, Salim Roukos, Matei Zaharia, Christopher Potts
| Challenge: | Neural information retrieval (IR) systems have progressed rapidly in recent years . many IR benchmarks focus on downstream task accuracy, concealing costs incurred . |
| Approach: | They propose to include efficiency considerations on IR benchmarks to help drive progress . eral et al. propose to incorporate query latency and cost budgets into evaluation . |
| Outcome: | a new study shows that the best IR system varies according to how efficiency considerations are chosen and weighed . the proposed benchmarks would allow for more thorough exploration of possible system designs . |
CQE: A Comprehensive Quantity Extractor (2023.emnlp-main)
Copied to clipboard
| Challenge: | Quantities are essential in documents to describe factual information. |
| Approach: | They propose a comprehensive quantity extraction framework that detects combinations of values and units, the behavior of a quantity and the concept a quantity is associated with. |
| Outcome: | The proposed framework outperforms existing methods and is the first to detect concepts associated with identified quantities. |
Centrality-aware Product Retrieval and Ranking (2024.emnlp-industry)
Copied to clipboard
| Challenge: | Ambiguity and complexity of user queries often lead to mismatch between user’s intent and retrieved product titles or documents. |
| Approach: | They propose a user-intent centrality optimization approach which optimizes for the user intent in semantic product search. |
| Outcome: | The proposed approach improves product ranking efficiency for ambiguous queries and lexical terms with alphanumeric characters. |
Explain then Rank: Scale Calibration of Neural Rankers Using Natural Language Explanations from LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Neural ranking models produce the final document scores, but they are often treated as transient information and only the relative orderings are preserved to produce a ranking. |
| Approach: | They propose to exploit large language models (LLMs) to provide relevance and uncertainty signals for these neural text rankers to produce scale-calibrated scores through Monte Carlo sampling of natural language explanations (NLEs). |
| Outcome: | The proposed approach outperforms previous calibration methods and LLM-based methods for ranking, calibration, and query performance prediction tasks. |
Measuring and Addressing Indexical Bias in Information Retrieval (2024.findings-acl)
Copied to clipboard
| Challenge: | Information Retrieval (IR) systems may not optimize rankings for fairness, neutrality, or the balance of ideas. |
| Approach: | They propose to use a framework to automatically audit IR rankings for indexical biases, or biase in the positional order of documents. |
| Outcome: | The proposed bias metric can help predict when and how indexical bias will shift a reader’s opinion. |
Beyond [CLS] through Ranking by Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on generative ranking models for Information Retrieval has focused on discriminative methods that learn a similarity function to compare questions and candidates answers. |
| Approach: | They propose to use a language model to train a ranking function that model the semantic similarity of documents and queries instead of discriminative ranking functions. |
| Outcome: | The proposed approaches are as effective as state-of-the-art discriminative models for the answer selection task and show unlikelihood losses are reduced for IR. |
MrRank: Improving Question Answering Retrieval System through Multi-Result Ranking Model (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing IR techniques contain deficiencies, posing a performance bottleneck . combining diverse approaches to retrieve information is a viable strategy . |
| Approach: | They propose an approach that leverages learning-to-rank techniques to combine heterogeneous IR systems. |
| Outcome: | The proposed method outperforms existing methods on two Retrieval Question Answering tasks. |
Q2R: A Query-to-Resolution System for Natural-Language Queries (2022.naacl-industry)
Copied to clipboard
| Challenge: | Existing text ranking methods are expensive since they require a parametric classifier to retrieve a small D D. |
| Approach: | They propose a system that combines direct classification with standard content-based retrieval approaches to significantly improve the relevance of retrieved documents. |
| Outcome: | The proposed system improves the relevance of retrieved documents by using a novel Q2R orchestration framework. |
Sparse, Dense, and Attentional Representations for Text Retrieval (2021.tacl-1)
Copied to clipboard
| Challenge: | Dual encoders perform retrieval by encoding documents and queries into dense low-dimensional vectors, scoring each document by its inner product with the query. |
| Approach: | They propose a dual-encoder-based neural model that combines the efficiency of dual encoders with expressiveness of more costly attentional architectures. |
| Outcome: | The proposed model outperforms strong alternatives in large-scale retrieval. |