STACKFEED: Structured Textual Actor-Critic Knowledge base editing with FEEDback

Challenge:	Large Language Models (LLMs) often generate incorrect or outdated information, especially in low-resource settings or when dealing with private data.
Approach:	They propose a framework that iteratively refines the knowledge base based on expert feedback . they define a ReACT actor agent on each document to perform structured edits .
Outcome:	The proposed framework improves the quality and performance of the RAG system on low-resource programming problems, modified Python packages, and factual question-answering tasks.

Similar Papers

Overview

Challenge

Approach

Outcome

RAG-Critic: Leveraging Automated Critic-Guided Agentic Workflow for Retrieval Augmented Generation (2025.acl-long)

Copied to clipboard

Guanting Dong, Jiajie Jin, Xiaoxi Li, Yutao Zhu, Zhicheng Dou, Ji-Rong Wen

Information Retrieval

Challenge:	Recent advances in large language models (LLMs) have demonstrated remarkable performance across a wide range of downstream tasks.
Approach:	They propose a framework that leverages a critic-guided agentic workflow to improve RAG capabilities autonomously.
Outcome:	The proposed framework improves RAG capabilities autonomously by leveraging a critic-guided agentic workflow.

MAIN-RAG: Multi-Agent Filtering Retrieval-Augmented Generation (2025.acl-long)

Copied to clipboard

Chia-Yuan Chang, Zhimeng Jiang, Vineeth Rakesh, Menghai Pan, Chin-Chia Michael Yeh, Guanchu Wang, Mingzhi Hu, Zhichao Xu, Yan Zheng, Mahashweta Das, Na Zou

Information Retrieval

Challenge:	Existing RAG systems struggle with the quality of retrieval documents, causing performance degradation and reducing performance.
Approach:	They propose a training-free RAG framework that leverages multiple LLM agents to collaboratively filter and score retrieved documents.
Outcome:	The proposed framework outperforms existing RAG frameworks in QA benchmarks and shows superior answer consistency and answer accuracy over baseline methods.

Fine-grained Knowledge Enhancement for Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Jingxuan Han, Zhendong Mao, Yi Liu, Yexuan Che, Zheren Fu, Quan Wang

Information Retrieval

Challenge:	Existing studies rely on semantic similarity to retrieve knowledge but ignore fine-grained information within documents.
Approach:	They propose a fine-grained knowledge enhancement method to fill knowledge gaps with retrieved external information by a Chain-of-Thought prompting procedure and a decoding enhancement strategy to constrain the document-based decoding process.
Outcome:	The proposed method can be applied in a plug-and-play manner to enhance its performance with no additional modules or training process.

CriticSearch: Fine-Grained Credit Assignment for Search Agents via a Retrospective Critic (2026.findings-acl)

Copied to clipboard

Yaocheng Zhang, Haohuan Huang, Zijun Song, Zijie Zhao, Qichao Zhang, Yuanheng Zhu, Dongbin Zhao

Reasoning

Challenge:	Existing search agent pipelines rely on sparse outcome rewards, leading to inefficient exploration and unstable training.
Approach:	They propose a tool-integrated reasoning framework that provides turn-level feedback via a retrospective critic mechanism.
Outcome:	The proposed framework outperforms baselines in multi-hop reasoning benchmarks and achieves faster convergence and training stability.

RA-ISF: Learning to Answer and Understand from Retrieval Augmentation via Iterative Self-Feedback (2024.findings-acl)

Copied to clipboard

Yanming Liu, Xinyue Peng, Xuhong Zhang, Weihao Liu, Jianwei Yin, Jiannan Cao, Tianyu Du

Information Retrieval

Challenge:	Large language models (LLMs) have demonstrated excellent performance in numerous tasks but the parameterized knowledge stored within LLMs may be incomplete and hard to incorporate up-to-date knowledge.
Approach:	They propose a framework that iteratively decomposes tasks and processes them in three submodules to enhance the model’s problem-solving capabilities.
Outcome:	The proposed method outperforms existing benchmarks on GPT3.5, Llama2 and other large language models significantly enhancing factual reasoning capabilities and reducing hallucinations.

HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases (2025.acl-long)

Copied to clipboard

Meng-Chieh Lee, Qi Zhu, Costas Mavromatis, Zhen Han, Soji Adeshina, Vassilis N. Ioannidis, Huzefa Rangwala, Christos Faloutsos

Knowledge Representation

Challenge:	Existing methods for retrieving information from a semi-structured knowledge base are struggling with hybrid questions.
Approach:	They propose a retrieval method that leverages both textual and relational information from a semi-structured knowledge base to answer user questions.
Outcome:	The proposed method surpasses all baselines on the STaRK benchmark and achieves significant performance gains.

Retrieving, Rethinking and Revising: The Chain-of-Verification Can Improve Retrieval Augmented Generation (2024.findings-emnlp)

Copied to clipboard

Bolei He, Nuo Chen, Xinran He, Lingyong Yan, Zhenkai Wei, Jinchang Luo, Zhen-Hua Ling

Semantic Text Processing

Challenge:	Recent Retrieval Augmented Generation (RAG) aims to enhance Large Language Models . however, such approach can generate inconsistent answer with external references .
Approach:	They propose to integrate the verification module into the RAG to improve external retrieval correctness and internal generation consistency.
Outcome:	The proposed model can significantly surpass the state-of-the-art baselines using different LLM backbones.

Improving Retrieval-Augmented Generation without Taxonomy-based Error Categorization (2026.acl-short)

Copied to clipboard

Gongbo Zhang, Yifan Peng, Chunhua Weng

Information Retrieval

Challenge:	Recent work implicitly assumes reliable critic feedback and focuses on planning strategies, while paying limited attention to the robustness of the error correction process itself.
Approach:	They propose a response-action learning paradigm that maps flawed RAG outputs to error-mitigating action plans without explicit criticism.
Outcome:	The proposed model improves the factual accuracy of large language model outputs without explicit error categorization.

Collaborative Chain-of-Agents for Parametric-Retrieved Knowledge Synergy (2026.acl-long)

Copied to clipboard

Yi Jiang, Sendong Zhao, Jianbo Li, Haochun Wang, Lizhe Zhang, Yan Liu, Bing Qin

Information Retrieval

Challenge:	Existing RAG methods focus on external retrieval, while ignoring the rich content of the model.
Approach:	They propose a framework that enhances explicit synergy over parametric and retrieved knowledge by integrating external retrieval components into the input context of the LLMs.
Outcome:	The proposed framework enhances explicit synergy over parametric and retrieved knowledge.

CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language Models (2025.findings-emnlp)

Copied to clipboard

Feiyang Li, Peng Fang, Zhan Shi, Arijit Khan, Fang Wang, Weihao Wang, null Zhangxin-hw, Cui Yongjian

Multimodality

Challenge:	Chain-of-thought reasoning has two key limitations: lack of reliability when solely relying on LLM-generated reasoning chains and interference from natural language reasoning steps with the models’ inference logic.
Approach:	They propose a chain-of-thought reasoning framework with three key designs to address these issues.
Outcome:	The proposed framework improves the performance of large language models on complex tasks by incorporating knowledge graphs and learnable knowledge case-aware RAG.