E-Verify: A Paradigm Shift to Scalable Embedding-based Factuality Verification (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing factuality verification methods follow a Decompose-Then-Verify paradigm, which improves granularity but suffers from poor scalability and efficiency. |
| Approach: | They propose a Decompose-Embed-Interact paradigm that shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space. |
| Outcome: | The proposed paradigm shifts factuality verification from costly text-level reasoning to efficient alignment in embedding space . |
Similar Papers
FactLens: Benchmarking Fine-Grained Fact Verification (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have shown impressive capability in language generation and understanding, but their tendency to hallucinate and produce factually incorrect information remains a key limitation. |
| Approach: | They propose a benchmark to evaluate fine-grained fact verification where claims are broken down into smaller sub-claims for individual verification. |
| Outcome: | The proposed model enables more precise identification of inaccuracies, improved transparency, and reduced ambiguity in evidence retrieval. |
FactBench: A Dynamic Benchmark for In-the-Wild Language Model Factuality Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | Language models (LMs) generate false or unverifiable content, often known as hallucination, despite ongoing efforts to enhance their factuality. |
| Approach: | They propose a tool that measures LMs’ factuality in real-world user interactions by evaluating their factual accuracy and categorizing content units as Supported, Unsupported, or Undecidable based on Web-retrieved evidence. |
| Outcome: | The proposed evaluation pipeline measures language models’ factuality in real-world user interactions. |
LoReFact: Bridging the Logic Gap in Fact-Checking (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing fact-checking methods focus on verification of individual facts, overlooking logical dependencies . a recent study shows that text containing logical errors may still be misjudged as factual . |
| Approach: | They propose a content–logic coupled factuality evaluation paradigm that conceptualizes factual dimension along two complementary dimensions: content factualism and logic factuity. |
| Outcome: | The proposed paradigm bridges the gap between factual verification and content factuality . it incorporates the logical dimension and a logic-aware metric to expose and penalize logical fallacies. |
FactAlign: Long-form Factuality Alignment of Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models have demonstrated significant potential as the next-generation information access engines, but reliability is hindered by issues of hallucination and generating non-factual content. |
| Approach: | They propose a novel alignment framework that enhances the factuality of LLMs’ long-form responses while maintaining their helpfulness. |
| Outcome: | The proposed framework improves factuality of LLMs while maintaining helpfulness. |
MR-ALIGN: Meta-Reasoning Informed Factuality Alignment for Large Reasoning Models (2026.findings-acl)
Copied to clipboard
Xinming Wang, Jian Xu, Bin Yu, Sheng Lian, yi Chen, Boran Wang, Yingjian Zhu, Hongzhu Yi, Hong-Ming Yang, Han Hu, Cheng-Lin Liu, Xu-Yao Zhang
| Challenge: | Large reasoning models (LRMs) show strong capabilities in complex reasoning, yet their marginal gains on evidence-dependent factual questions are limited. |
| Approach: | They propose a Meta-Reasoning informed alignment framework that quantifies state-transition probabilities along the model’s thinking process and constructs a transition-aware implicit reward that reinforces beneficial reasoning patterns while suppressing defective ones at the atomic thinking segments. |
| Outcome: | Empirical evaluations of four factual QA datasets and one long-form factuality benchmark show that MR-ALIGN consistently improves accuracy and truthfulness while reducing misleading reasoning. |
DnDScore: Decontextualization and Decomposition for Factuality Verification in Long-Form Text Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent measures of factual precision use a decompose-then-verify framework . decontextualization is the process of augmenting subclaims with necessary context . |
| Approach: | They evaluate different decomposition, decontextualization and verification strategies . they introduce a deconstructualization aware verification method that validates subclaims in context . |
| Outcome: | The proposed method decomposes claims and independently verifyes them . it introduces a decontextualization aware verification method that validates subclaims in context . |
FAITH: Factuality Alignment through Integrating Trustworthiness and Honestness (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to correct factually inaccurate outputs are lacking the semantic richness needed to properly understand its internal states of trustworthiness and honesty. |
| Approach: | They propose a framework for factuality alignment that integrates natural-language uncertainty signals with external knowledge and computes confidence scores and semantic entropy from LLM outputs. |
| Outcome: | Extensive experiments on four knowledge-intensive benchmarks show that FAITH improves the factual accuracy and truthfulness of Large Language Models (LLMs). |
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) often struggle to accurately express factual knowledge, especially in cases where the knowledge boundaries are ambiguous. |
| Approach: | They propose a framework that leverages Uncertainty estimations to represent knowledge boundaries and incorporates these representations into prompts for LLMs to Align with factual knowledge. |
| Outcome: | The proposed framework significantly improves the LLMs’ capacities to confidently answer known questions and refuse unknown questions on both in-domain and out-of-domain tasks. |
Optimizing Decomposition for Optimal Claim Verification (2025.acl-long)
Copied to clipboard
| Challenge: | Existing decomposition and verification paradigms ignore their interactions and potential misalignment. |
| Approach: | They propose a reinforcement learning framework that leverages verifier feedback to learn a policy for dynamically decomposing claims to verifier-preferred atomicity. |
| Outcome: | The proposed framework outperforms existing decomposition policies in verification confidence tests . it improves accuracy and confidence by 0.12 on average across varying verifiers, datasets, and atomcities of input claims. |
Temporally Consistent Factuality Probing for Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are used as an alternative knowledge base for many tasks. |
| Approach: | They propose a temporally consistent factuality probe task that extends the consistency probe in the temporal dimension. |
| Outcome: | The proposed task extends the definitions of existing metrics to represent consistent factuality across temporal dimension. |