When Claims Evolve: Evaluating and Enhancing the Robustness of Embedding Models Against Misinformation Edits (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing claims-matching systems that use sentence embedding models are not robust to edits as users interact with claims online. |
| Approach: | They propose a perturbation framework that generates valid and natural claim variations and evaluate different mitigation approaches to improve their findings. |
| Outcome: | The proposed framework evaluates embedding models in a multi-stage retrieval pipeline and identifies the effectiveness of mitigation approaches. |
Similar Papers
RobustSentEmbed: Robust Sentence Embeddings Using Adversarial Self-Supervised Contrastive Learning (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing pre-trained language models exhibit poor generalization and robustness in adversarial settings. |
| Approach: | They propose a self-supervised sentence embedding framework that improves generalization and robustness against adversarial attacks. |
| Outcome: | The proposed framework reduces the success rate of adversarial attacks by almost half . it also improves semantic text similarity tasks and various transfer tasks . |
RobustEmbed: Robust Sentence Embeddings Using Self-Supervised Contrastive Pre-Training (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing PLMs suffer from poor robustness in adversarial scenarios, despite their success with unseen samples. |
| Approach: | They propose a self-supervised sentence embedding framework that enhances generalization and robustness in various text representation tasks and against diverse adversarial attacks. |
| Outcome: | The proposed framework improves generalization and robustness in various representation tasks and against diverse adversarial attacks. |
Towards Effective Extraction and Evaluation of Factual Claims (2025.acl-long)
Copied to clipboard
| Challenge: | Lack of a standardized evaluation framework impedes assessment and comparison of claim extraction methods. |
| Approach: | They propose a framework for evaluating claim extraction in the context of fact-checking . they also introduce Claimify, an LLM-based claim extraction method . |
| Outcome: | The proposed evaluation framework outperforms existing methods in the evaluation of claim extraction methods. |
Complex Claim Verification with Evidence Retrieved in the Wild (2024.naacl-long)
Copied to clipboard
| Challenge: | Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: no access to evidence, access to curated evidence, or access to published evidence after a claim was made. |
| Approach: | They propose a pipeline to check claims using raw evidence from the web . they restrict their retriever to only search documents available prior to the claim's making . |
| Outcome: | The proposed method is based on a political claim dataset and shows that the evidence summary produced by the system is reliable and relevant to answering key questions. |
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have brought us a proliferation of false claims online, which spread fast . fact-checkers have been using automated fact-finding to verify claims . |
| Approach: | They propose a system that can detect claims that can be fact-checked by a given database . they create a manually annotated document dataset and propose evaluation measures . |
| Outcome: | The proposed system achieves sizable performance gains over strong baselines. |
Document-level Claim Extraction and Decontextualisation for Fact-Checking (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level claim extraction focus on identifying and extracting claims from individual sentences. |
| Approach: | They propose a method for document-level claim extraction for fact-checking which aims to extract check-worthy claims from documents and decontextualise them so they can be understood out of context. |
| Outcome: | The proposed method extracts check-worthy claims from documents and decontextualises them so they can be understood out of context. |
Beyond Static Artifacts: An Evolutionary Framework for Synthetic Claim Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Existing claim detection benchmarks treat claims as static textual artifacts . current research ignores sociological etiology of how information naturally emerges and mutates . |
| Approach: | They propose a socially generative framework for synthetic claim generation . they propose utterance, proposition and context-based simulations to capture truth decay . |
| Outcome: | The proposed paradigm models claims as socially evolving entities . it allows precise simulation of truth decay and intervened propagation with multi-auditor oversight . |
Evaluating Robustness of Generative Search Engine on Adversarial Factoid Questions (2024.findings-acl)
Copied to clipboard
Xuming Hu, Xiaochuan Li, Junzhe Chen, Yinghui Li, Yangning Li, Xiaoguang Li, Yasheng Wang, Qun Liu, Lijie Wen, Philip Yu, Zhijiang Guo
| Challenge: | Existing large language models (LLMs)-backed generative search engines may not always be accurate. |
| Approach: | They propose to evaluate the robustness of retrieval-augmented generation in a realistic and high-risk setting where adversaries have only black-box system access. |
| Outcome: | The proposed model exhibits higher susceptibility to factual errors compared to LLMs without retrieval. |
Mask-to-Correct+: Leveraging Retriever Diversity for Masking-guided Faithful Fact Correction (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for fact correction ignore semantic faithfulness in their process. |
| Approach: | They propose a supervised learning approach that uses a diversity-aware masking approach to identify erroneous spans of claims and evaluate the faithfulness of corrections using retrieved evidence. |
| Outcome: | The proposed framework outperforms baseline frameworks on social media datasets, achieving up to 14% improvement in SARI scores, without using gold evidence. |
Claim Verification in the Age of Large Language Models: A Survey (2026.acl-srw)
Copied to clipboard
| Challenge: | Recent election cycles have seen a large number of false information spread across social media and news platforms. |
| Approach: | They propose a framework for automated claim verification using Large Language Models and Retrieval Augmented Generation. |
| Outcome: | The proposed frameworks are based on large-scale models and new methods such as Retrieval Augmented Generation (RAG). |