| Challenge: | Existing methods for extracting warrants from a corpus of arguments are lacking in argument detection. |
| Approach: | They propose to extract multiple warrants from an existing corpus of arguments and then aggregate them . they show that the method needs to be improved, but that it can still improve evidence detection. |
| Outcome: | The proposed method can improve the performance of evidence detection by analyzing arguments and aggregating them. |
Similar Papers
The Argument Reasoning Comprehension Task: Identification and Reconstruction of Implicit Warrants (N18-1)
Copied to clipboard
| Challenge: | Existing methods for analyzing warrants in natural language arguments are insufficient. |
| Approach: | They propose a method for reconstructing warrants from news comments . they use a crowdsourcing process to obtain warrants for 2k authentic arguments . |
| Outcome: | The proposed method will define a substantial step towards automatic warrant reconstruction. |
Document-level Claim Extraction and Decontextualisation for Fact-Checking (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods for document-level claim extraction focus on identifying and extracting claims from individual sentences. |
| Approach: | They propose a method for document-level claim extraction for fact-checking which aims to extract check-worthy claims from documents and decontextualise them so they can be understood out of context. |
| Outcome: | The proposed method extracts check-worthy claims from documents and decontextualises them so they can be understood out of context. |
Complex Claim Verification with Evidence Retrieved in the Wild (2024.naacl-long)
Copied to clipboard
| Challenge: | Prior work makes simplifying assumptions in retrieval that depart from real-world use cases: no access to evidence, access to curated evidence, or access to published evidence after a claim was made. |
| Approach: | They propose a pipeline to check claims using raw evidence from the web . they restrict their retriever to only search documents available prior to the claim's making . |
| Outcome: | The proposed method is based on a political claim dataset and shows that the evidence summary produced by the system is reliable and relevant to answering key questions. |
Towards Effective Extraction and Evaluation of Factual Claims (2025.acl-long)
Copied to clipboard
| Challenge: | Lack of a standardized evaluation framework impedes assessment and comparison of claim extraction methods. |
| Approach: | They propose a framework for evaluating claim extraction in the context of fact-checking . they also introduce Claimify, an LLM-based claim extraction method . |
| Outcome: | The proposed evaluation framework outperforms existing methods in the evaluation of claim extraction methods. |
Beyond Single-Event Extraction: Towards Efficient Document-Level Multi-Event Argument Extraction (2024.findings-acl)
Copied to clipboard
Wanlong Liu, Li Zhou, DingYi Zeng, Yichen Xiao, Shaohuan Cheng, Chen Zhang, Grandee Lee, Malu Zhang, Wenyu Chen
| Challenge: | mainstream event argument extraction methods process each event in isolation, resulting in inefficient inference and ignoring correlations among multiple events. |
| Approach: | They propose a multi-event argument argument extraction model which extracts arguments from all events simultaneously. |
| Outcome: | The proposed model performs better on four public datasets while saving time. |
Improving Evidence Retrieval for Automated Explainable Fact-Checking (2021.naacl-demos)
Copied to clipboard
| Challenge: | Automated fact-checking on a large scale is time consuming and intractable. |
| Approach: | They propose a three-stage automated fact-checking system using evidence retrieval and selection methods to improve evidence recall in a noisy environment. |
| Outcome: | The proposed system can verify open-domain claims using results from web search engines. |
Hierarchical Evidence Set Modeling for Automated Fact Extraction and Verification (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for fact extraction and verification combine all evidence sentences to produce redundant information. |
| Approach: | They propose a framework to extract evidence sets and verify a claim to be supported, refuted or not enough info . they propose to encode and attend the claim and evidence sets at different levels of hierarchy . |
| Outcome: | The proposed framework outperforms 7 state-of-the-art methods for fact extraction and verification. |
Multi-hop Evidence Retrieval for Cross-document Relation Extraction (2023.findings-acl)
Copied to clipboard
| Challenge: | Relation Extraction (RE) is a task that seeks to identify the relation of entities described according to some context. |
| Approach: | They propose a multi-hop evidence retrieval method based on evidence path mining and ranking to support cross-document relation extraction. |
| Outcome: | The proposed method acquires cross-document evidence and boosts performance in both closed and open environments. |
A Two-Step Approach for Implicit Event Argument Detection (2020.acl-main)
Copied to clipboard
| Challenge: | et al., 2015) only consider local arguments in the same sentence of the event trigger. |
| Approach: | They propose to decompose the implicit event argument detection task into two sub-problems . they propose to use argument head-word detection and head-to-span expansion to reduce the number of candidates. |
| Outcome: | The proposed model achieves better performance than a strong sequence labeling baseline. |
Evidence Retrieval for Fact Verification using Multi-stage Reranking (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing evidence retrieval methods are limited by single-stage evidence extraction. |
| Approach: | They propose to use a multi-stage reranking paradigm to enhance the fact verification process by increasing the recall of sentences by 7.85%, tables by 8.29% and cells by 3% compared to the current state-of-the-art. |
| Outcome: | The proposed system outperforms state-of-the-art models and achieves a 93.63% recall rate for Wikipedia pages. |