Challenge: Large Language Models (LLMs) are proficient at retrieving single facts from extended contexts, but struggle with tasks requiring simultaneous retrieval of multiple facts.
Approach: They propose a method that refines context through successive rounds of rewriting to address this problem by finding all Crucial Texts (FACT)
Outcome: The proposed method improves multi-fact retrieval performance across tasks, though improvements are less notable in general-purpose QA scenarios.

Similar Papers

Context-Efficient Retrieval with Factual Decomposition (2025.naacl-short)

Copied to clipboard

Challenge: Existing models that use dynamically expanding text can be incorporated into large language models.
Approach: They show that pre-processing external corpus into semi-structured "atomic facts" reduces the size of the context and improves inference efficiency.
Outcome: The proposed form of atomic facts improves on question answering tasks when the amount of retrieved text is limited.
Tracing and Dissecting How LLMs Recall Factual Knowledge for Real World Questions (2025.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have shown promising ability to perform commonsense reasoning.
Approach: They propose a two-dimensional analysis framework that incorporates token back-tracing and token decoding to uncover how LLMs conduct factual knowledge recall.
Outcome: The proposed framework shows that LLMs lack relevant knowledge but struggle to select the most accurate information based on context during the retrieval and rerank phase.
Found in the middle: Calibrating Positional Attention Bias Improves Long Context Utilization (2024.findings-acl)

Copied to clipboard

Challenge: Large language models struggle to capture relevant information located in the middle of their input.
Approach: They propose a calibration mechanism that allows the model to attend to contexts faithfully according to their relevance even when they are in the middle.
Outcome: The proposed calibration mechanism mitigates this positional bias and improves retrieval-augmented generation performance.
Paths Not Taken: Understanding and Mending the Multilingual Factual Recall Pipeline (2025.emnlp-main)

Copied to clipboard

Challenge: Multilingual large language models (LLMs) exhibit factual inconsistencies across languages . authors identify two primary sources of error: insufficient engagement of reliable English-centric mechanism for factual recall, and incorrect translation from English back into the target language for the final answer.
Approach: They propose two vector interventions to redirect the model toward better internal paths for higher factual consistency.
Outcome: The proposed interventions increase the recall accuracy by over 35 percent for the lowest-performing language.
Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training (2024.acl-long)

Copied to clipboard

Challenge: Large language models suffer from severe hallucinations, compromising performance in knowledge-oriented QA, dialogue, and writing.
Approach: They propose to enhance the information searching and reflection ability of large language models by training them in position-agnostic multi-step QA tasks to improve their model's accuracy.
Outcome: The proposed model improves in multi-doc QA and other benchmarks by 13.7% absolute gain in shuffled settings, by 21.5% in passage retrieval task.
Retrieval Helps or Hurts? A Deeper Dive into the Efficacy of Retrieval Augmentation to Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Large language models (LMs) excel in retrieving popular facts, but encounter difficulty with infrequent entity-relation pairs compared to retrievers.
Approach: They propose to use a WiTQA dataset to explore the effects of combinations of entities and relations on LMs.
Outcome: The proposed model can retain popular relations of less common entities while retaining the same popular relations.
Unveiling Factual Recall Behaviors of Large Language Models through Knowledge Neurons (2024.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have underscored their exceptional reasoning prowess with natural language understanding across a broad spectrum of tasks.
Approach: They examine whether Large Language Models actively recall or retrieve their internal repositories of factual knowledge when faced with reasoning tasks.
Outcome: The proposed model improves reasoning performance while suppressing it leads to notable degradation.
Factual Retrieval in LLMs Is a Redundant, Distributed and Non-Contiguous Process (2026.acl-long)

Copied to clipboard

Challenge: Existing work posits that factual knowledge is stored at the last entity token position, but the precise mechanics of how facts are retrieved from model parameters remain unclear.
Approach: They propose an iterative patching protocol to identify a minimal subset of layers necessary for attribute retrieval.
Outcome: The proposed method shows that models possess multiple paths for the same entity and fact, highlighting a high degree of redundancy in attribute computation.
Lost in the Distance: Large Language Models Struggle to Capture Long-Distance Relational Knowledge (2025.findings-naacl)

Copied to clipboard

Challenge: Recent large language models have demonstrated impressive capabilities in handling long contexts . however, as context length increases, LLMs struggle more with filtering out irrelevant information .
Approach: They propose to use unrelated sentences to capture relational knowledge over long contexts . they find that LLMs can handle edge noise with little impact, but can reason about distant relationships .
Outcome: The proposed model can handle edge noise with little impact, but its ability to reason about distant relationships declines as the noise grows.
Unraveling Misinformation Propagation in LLM Reasoning (2025.findings-emnlp)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated impressive capabilities in reasoning, but how they propagate within their reasoning process remains underexplored.
Approach: They propose a practical approach to mitigating misinformation propagation in LLMs by applying factual corrections early in the reasoning process and fine-tuning on synthesized data with early-stage corrections significantly improves reasoning factuality.
Outcome: The proposed model can correct misinformation when explicitly instructed, but fails to correct misinformation less than half the time even with explicit instructions.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations