Enhancing Retrieval Systems with Inference-Time Logical Reasoning (2025.acl-short)
Copied to clipboard
| Challenge: | Existing retrieval methods rely on transforming user queries into vector representations and retrieving documents based on cosine similarity and static embeddings. |
| Approach: | They propose an inference-time logical reasoning framework that incorporates logical thinking into retrieval process. |
| Outcome: | The proposed method outperforms traditional retrieval methods on synthetic and real-world benchmarks on synthetic queries and datasets. |
Similar Papers
Aristotle: Mastering Logical Reasoning with A Logic-Complete Decompose-Search-Resolve Framework (2025.acl-long)
Copied to clipboard
Jundong Xu, Hao Fei, Meng Luo, Qian Liu, Liangming Pan, William Yang Wang, Preslav Nakov, Mong-Li Lee, Wynne Hsu
| Challenge: | Existing systems fail to fully leverage the structure of logical tasks throughout the reasoning process, causing bottlenecks in efficiency and efficacy. |
| Approach: | They propose a logic-complete reasoning framework, Aristotle, which integrates symbolic expressions and logical rules into the entire reasoning process. |
| Outcome: | The proposed framework outperforms state-of-the-art reasoning frameworks in accuracy and efficiency. |
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for logical reasoning of text focus on contextual semantics while struggling to explicitly model the logical inference process. |
| Approach: | They propose a logic-driven context extension framework and a data-driven augmentation algorithm that uses contrastive learning to better capture logical information. |
| Outcome: | The proposed framework outperforms existing methods on two benchmark datasets, ReClor and LogiQA. |
LogicTree: Structured Proof Exploration for Coherent and Rigorous Logical Reasoning with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have remarkable multi-step reasoning capabilities, but they still face challenges in complex logical reasoning. |
| Approach: | They propose an algorithm-guided search framework that automates structured proof exploration and ensures logical coherence. |
| Outcome: | The proposed framework outperforms o3-mini and chain-of-thought with average gains of 23.6% and 12.5% on five datasets. |
Decomposing Complex Queries for Tip-of-the-tongue Retrieval (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Tip-of-the-tongue retrieval is a retrieval setting in which a user is unable to formulate a precise query that identifies a sought item . a framework that decomposes complex queries into subqueries can improve gold book recall . |
| Approach: | They propose a framework for handling tip-of-the-tongue queries by decomposing queries into individual clues routing them to specialized retrievers. |
| Outcome: | The proposed framework improves gold book recall up to 6% on a new query-book pair . it takes advantage of off-the-shelf retrievers or incorporates retriever-specific logic . |
ReFSQL: A Retrieval-Augmentation Framework for Text-to-SQL Generation (2023.findings-emnlp)
Copied to clipboard
Kun Zhang, Xiexiong Lin, Yuanzhuo Wang, Xin Zhang, Fei Sun, Cen Jianhe, Hexiang Tan, Xuhui Jiang, Huawei Shen
| Challenge: | Existing methods that align natural language with SQL Language underestimate inherent structural characteristics of SQL and lead to structure errors. |
| Approach: | They propose a retrieval-argument framework that aligns natural language with SQL Language and trains one encoder-decoder-based model to fit all questions. |
| Outcome: | The proposed framework improves accuracy and robustness of text-to-SQL generation on five datasets. |
BoolQuestions: Does Dense Retrieval Understand Boolean Logic in Language? (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Dense retrieval systems focus on optimizing text embedding space while overlooking Boolean logic in language. |
| Approach: | They propose a task to investigate whether retrieval systems can comprehend Boolean logic in language. |
| Outcome: | The proposed method is based on a benchmark dataset covering complex queries containing basic Boolean logic and corresponding annotated passages. |
Logical Structure as Knowledge: Enhancing LLM Reasoning via Structured Logical Knowledge Density Estimation (2026.findings-acl)
Copied to clipboard
Zhen Bi, Zhenlin Hu, Xueshu Chen, Mingyang Chen, Cheng Deng, Yida Xue, Zhen Wang, Qing Shen, Ningyu Zhang, Jungang Lou
| Challenge: | Existing data-centric paradigms equate quality with factuality or diversity and ignore the internal logical complexity of training samples. |
| Approach: | They propose a density-aware re-cognizing optimization strategy that prioritizes high-density logical samples to align training with the model's reasoning boundary. |
| Outcome: | The proposed metric outperforms existing methods and improves reasoning performance without increasing total data volume. |
A Survey of Reasoning-Intensive Retrieval: Progress and Challenges (2026.acl-long)
Copied to clipboard
| Challenge: | Reasoning-Intensive Retrieval (RIR) targets retrieval settings where relevance is mediated by latent inferential links between a query and supporting evidence, rather than semantic similarity. |
| Approach: | They propose a taxonomy that categorizes methods based on where and how reasoning is integrated into the retrieval pipeline. |
| Outcome: | The proposed method framework provides a detailed analysis of the current landscape and its trade-offs and practical applications. |
Multi-Step Inference for Reasoning Over Paragraphs (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for complex reasoning use symbols or black-box transformers . a compositional model can chain together free-form predicates and logical connectives . |
| Approach: | They propose a compositional model that finds relevant sentences and then chains them together using neural modules. |
| Outcome: | The proposed model improves performance on a recently-introduced dataset. |
Logical Inference for Counting on Semi-structured Tables (2022.acl-srw)
Copied to clipboard
| Challenge: | Natural Language Inference (NLI) tasks require numerical understanding to perform a numerical type of inference, such as counting. |
| Approach: | They propose a logical inference system for reasoning between semi-structured tables and texts that uses logical representations as meaning representations and model checking to handle a numerical type of inference. |
| Outcome: | The proposed system can perform inference with numerical comparatives with tables and texts in English. |