| Challenge: | Existing studies have investigated individual components of fact checking process but none offer such a capability. |
| Approach: | They propose a framework that integrates various components of a fact-checking process. |
| Outcome: | The proposed framework integrates various components of a fact-checking process to predict the factuality of claims and provide evidence at the document and sentence level to explain its predictions. |
Similar Papers
Integrating Stance Detection and Fact Checking in a Unified Corpus (N18-2)
Copied to clipboard
| Challenge: | Existing methods for fact checking are not supported by existing datasets, which treat fact checking, document retrieval, source credibility, stance detection and rationale extraction as independent tasks. |
| Approach: | They propose to implement automatic fact checking on an Arabic fact checking corpus, which is the first of its kind. |
| Outcome: | The proposed approach is based on an Arabic fact checking corpus, the first of its kind. |
Factcheck-Bench: Fine-Grained Evaluation Benchmark for Automatic Fact-checkers (2024.findings-emnlp)
Copied to clipboard
Yuxia Wang, Revanth Gangi Reddy, Zain Mujahid, Arnav Arora, Aleksandr Rubashevskii, Jiahui Geng, Osama Mohammed Afzal, Liangming Pan, Nadav Borenstein, Aditya Pillai, Isabelle Augenstein, Iryna Gurevych, Preslav Nakov
| Challenge: | Large language models generate naturally sounding answers over a broad range of human inquiries, but they often generate answers that contradict real-world facts. |
| Approach: | They propose a framework for annotating and evaluating the factuality of large language models . they propose 'factcheck-bench' which provides a multi-stage annotation scheme . |
| Outcome: | The proposed framework outperforms several popular LLM fact-checkers in claim, sentence, and document levels. |
Improving Evidence Retrieval for Automated Explainable Fact-Checking (2021.naacl-demos)
Copied to clipboard
| Challenge: | Automated fact-checking on a large scale is time consuming and intractable. |
| Approach: | They propose a three-stage automated fact-checking system using evidence retrieval and selection methods to improve evidence recall in a noisy environment. |
| Outcome: | The proposed system can verify open-domain claims using results from web search engines. |
AFaCTA: Assisting the Annotation of Factual Claim Detection with Reliable LLM Annotators (2024.acl-long)
Copied to clipboard
| Challenge: | generative AI is a counter-measure to misinformation, but factual claim detection suffers from inconsistency in definitions and high cost of manual annotation. |
| Approach: | They propose a framework that assists in the annotation of factual claims with the help of large language models. |
| Outcome: | The proposed framework can be used to annotate factual claims with the help of large language models and can work with or without expert supervision. |
Task-Oriented Automatic Fact-Checking with Frame-Semantics (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing work on automatic fact-checking relies on unstructured data and large language models to produce fact- check verdicts and explanations. |
| Approach: | They propose a new paradigm for automatic fact-checking that leverages frame semantics to enhance the structured understanding of claims and guide the process of fact- checking them. |
| Outcome: | The proposed paradigm improves evidence retrieval and explainability for fact-checking by leveraging frame semantics. |
Automated Justification Production for Claim Veracity in Fact Checking: A Survey on Architectures and Approaches (2024.acl-long)
Copied to clipboard
| Challenge: | Current research focuses on predicting claim veracity through metadata analysis and language scrutiny, with an emphasis on justifying verdicts. |
| Approach: | They propose a comprehensive taxonomy for categorizing works based on various criteria and propose scalable methodologies for improving fact-checking explainability. |
| Outcome: | The proposed taxonomy identifies challenges while proposing future directions in fact-checking explainability. |
Explainable Automated Fact-Checking: A Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Steady progress has been made in fact-checking and its orthogonal tasks. |
| Approach: | They propose to use fact-checking explanations to explain predictions by comparing existing explanations against desirable properties to find out what makes for good explanations. |
| Outcome: | The proposed explanations are compared against desirable properties and show how they may lead to improvements in the research area. |
The Intended Uses of Automated Fact-Checking Artefacts: Why, How and Who (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Automated fact-checking is often presented as an epistemic tool fact-seekers, social media consumers, and other stakeholders can use to fight misinformation. |
| Approach: | They analyse 100 highly-cited papers and annotate epistemic elements related to intended use, i.e., means, ends, and stakeholders. |
| Outcome: | The proposed strategies are often left out of the literature and lack empirical backing. |
A Survey on Automated Fact-Checking (2022.tacl-1)
Copied to clipboard
| Challenge: | Fact-checking is an essential task in journalism due to the speed with which information and misinformation can spread in the media ecosystem. |
| Approach: | They propose to use natural language processing to automate fact-checking by identifying common concepts and defining definitions. |
| Outcome: | The proposed method can predict the veracity of claims using natural language processing, machine learning, and databases. |
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have brought us a proliferation of false claims online, which spread fast . fact-checkers have been using automated fact-finding to verify claims . |
| Approach: | They propose a system that can detect claims that can be fact-checked by a given database . they create a manually annotated document dataset and propose evaluation measures . |
| Outcome: | The proposed system achieves sizable performance gains over strong baselines. |