Challenge: Existing approaches to augment language models with external knowledge but they are limited by static nature of pre-training data.
Approach: They propose a lightweight approach that compresses retrieved documents into highly dense textual summaries to integrate into in-context RAG.
Outcome: The proposed approach reduces latency and costs while achieving high performance in open-domain questions.

Similar Papers

BRIEF-Pro: Universal Context Compression with Short-to-Long Synthesis for Fast and Accurate Multi-Hop Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Experiments show that BRIEF-Pro generates more concise and relevant summaries, enhancing performance across small, large, and proprietary language models.
Approach: They propose a universal, lightweight compressor that distills relevant evidence from retrieved documents into a concise summary for seamless integration into in-context RAG.
Outcome: Experiments on four open-domain multi-hop question-answering datasets show that BRIEF-Pro generates more concise and relevant summaries, enhancing performance across small, large, and proprietary language models.
Open-RAG: Enhanced Retrieval Augmented Reasoning with Open-Source Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods to integrate Large Language Models with external knowledge suffer from limited reasoning capabilities, especially when using open-source LLMs.
Approach: They propose a framework that transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks.
Outcome: The proposed framework transforms an arbitrary dense LLM into a parameter-efficient sparse mixture of experts (MoE) model capable of handling complex reasoning tasks, including both single- and multi-hop queries.
SARA: Selective and Adaptive Retrieval-augmented Generation with Context Compression (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) extends large language models with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts.
Approach: They propose a hybrid RAG framework that uses natural-language snippets and semantic compression vectors to preserve passages in text form and compress remaining evidence into interpretable vectors for iterative evidence reranking.
Outcome: The proposed framework improves answer relevance, answer correctness and semantic similarity across 9 datasets and 5 open-source LLMs.
Question Decomposition for Retrieval-Augmented Generation (2025.acl-srw)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) is effective for question answering tasks . multi-hop questions, such as "Which company among NVIDIA, Apple, and Google made the biggest profit in 2023?" challenge RAG because relevant facts are often distributed across multiple documents .
Approach: They propose a pipeline that incorporates question decomposition to ground large language models in verifiable external sources.
Outcome: The proposed approach improves retrieval and answer accuracy over standard RAG . multi-hop questions often require multiple documents to support the model .
Familiarity-Aware Evidence Compression for Retrieval-Augmented Generation (2025.findings-emnlp)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) improves large language models by incorporating non-parametric knowledge through evidence retrieved from external sources.
Approach: They propose a training-free evidence compression technique that makes retrieved evidence more familiar to the target model while seamlessly integrating parametric knowledge from the model.
Outcome: The proposed technique outperforms the most recent evidence compression baselines across open-domain QA datasets while achieving high compression rates.
RAG in the Wild: On the (In)effectiveness of LLMs with Mixture-of-Knowledge Retrieval Augmentation (2026.findings-acl)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) enhances large language models by integrating external knowledge retrieved at inference time.
Approach: They evaluate RAG systems using MassiveDS, a large-scale datastore with mixture of knowledge.
Outcome: The proposed approach improves performance on knowledge-intensive NLP tasks.
Inference Scaling for Bridging Retrieval and Augmented Generation (2025.findings-naacl)

Copied to clipboard

Challenge: Existing work observed the generator bias, such that improving the retrieval results may negatively affect the outcome.
Approach: They propose to use inference scaling to aggregate inference calls from the permuted order of retrieved contexts to create a new ranking.
Outcome: The proposed approach improves ROUGE-L on MS MARCO and EM on HotpotQA benchmarks by 7 points.
TRACE the Evidence: Constructing Knowledge-Grounded Reasoning Chains for Retrieval-Augmented Generation (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing retrievers are not perfect and often include irrelevant documents in the retrieved set.
Approach: They propose to construct knowledge-grounded reasoning chains from retrieved documents to integrate supporting evidence into RAG models.
Outcome: The proposed model achieves an average performance improvement of 14.03% on three multi-hop QA datasets.
Refiner: Restructure Retrieved Content Efficiently to Advance Question-Answering Capabilities (2024.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) are limited by their parametric knowledge, leading to hallucinations in knowledge-extensive tasks.
Approach: They propose an end-to-end extract-and-restructure paradigm that leverages a single decoder-only LLM to adaptively extract query-relevant contents verbatim along with the necessary context.
Outcome: Experiments show that a trained Refiner outperforms state-of-the-art RAG and compressing approaches in multiple tasks.
HopRAG: Multi-Hop Reasoning for Logic-Aware Retrieval-Augmented Generation (2025.findings-acl)

Copied to clipboard

Challenge: Traditional retrieval systems focus on lexical or semantic similarity rather than logical relevance.
Approach: They propose a new RAG framework that augments retrieval with logical reasoning . hopRAG uses a retrieve-reason-prune mechanism to explore multi-hop neighbors .
Outcome: The proposed framework outperforms conventional retrieval systems and state-of-the-art benchmarks on multi-hop QA tasks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations