| Challenge: | Empirical results show that using this approach improves the state of art performance across four benchmark argumentation data sets by an average of 4 absolute F1 points in claim detection. |
| Approach: | They propose to fine-tune a language model using a Reddit corpus of opinionated claims and use the internet acronyms IMO/IMHO to identify claims. |
| Outcome: | The proposed approach improves state of art performance across four benchmark argumentation data sets by an average of 4 absolute F1 points. |
Similar Papers
Leveraging fine-tuned Large Language Models with LoRA for Effective Claim, Claimer, and Claim Object Detection (2024.eacl-long)
Copied to clipboard
| Challenge: | Existing work on identifying claims has focused on sentence level, neglecting supplementary attributes such as the claimer and claim object of the claim. |
| Approach: | They propose a novel approach to detect claims using large language models in natural language understanding and text generation. |
| Outcome: | The proposed approach transforms claim, claimer and claim object detection task into QA setting. |
Can LLMs Clarify? Investigation and Enhancement of Large Language Models on Argument Claim Optimization (2025.coling-main)
Copied to clipboard
| Challenge: | While Large Language Models (LLMs) have demonstrated proficiency in text rewriting tasks such as style transfer and query rewrite, their application to claim optimization remains unexplored. |
| Approach: | They propose to use a sliding window mechanism to evaluate the performance of large language models in claim clarification tasks under different settings. |
| Outcome: | The proposed model improves the performance of three LLMs on the claim clarification task under zero-shot, few-shot and supervised fine-tuning settings. |
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection (2023.acl-long)
Copied to clipboard
| Challenge: | Out-of-distribution (OOD) detection is critical for reliable predictions over text . fine-tuning with pre-trained language models has been a de facto procedure . |
| Approach: | They propose to leverage pre-trained language models for OOD detection without fine-tuning on ID data. |
| Outcome: | The proposed approach outperforms the fine-tuned model under distributional shifts. |
Claim Verification in the Age of Large Language Models: A Survey (2026.acl-srw)
Copied to clipboard
| Challenge: | Recent election cycles have seen a large number of false information spread across social media and news platforms. |
| Approach: | They propose a framework for automated claim verification using Large Language Models and Retrieval Augmented Generation. |
| Outcome: | The proposed frameworks are based on large-scale models and new methods such as Retrieval Augmented Generation (RAG). |
LESA: Linguistic Encapsulation and Semantic Amalgamation Based Generalised Claim Detection from Online Content (2021.eacl-main)
Copied to clipboard
| Challenge: | Existing work on claim detection is built on the basis of a 'segregation' of claims across different domains. |
| Approach: | They propose a generalized generalized model that captures syntactic features through part-of-speech and dependency embeddings, as well as contextual features through a fine-tuned language model. |
| Outcome: | The proposed model outperforms baselines on six claim datasets by an average of 3 claim-F1 points and 2 claim-f1 points on the general-domain experiments. |
Improving the OOD Performance of Closed-Source LLMs on NLI Through Strategic Data Selection (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to improve robustness require changing the fine-tuning process or large-scale data augmentation, which are infeasible or cost prohibitive for closed-source models. |
| Approach: | They propose to prioritize more complex examples or replace existing training examples with LLM-generated data to improve performance on OOD NLI datasets. |
| Outcome: | The proposed methods improve performance on difficult OOD datasets while training with synthetic data leads to substantial improvements on easier OOD data. |
High-quality argumentative information in low resources approaches improve counter-narrative generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study shows that fine-tuning improves the performance of language models . large language models generate acceptable texts in a number of scenarios, a study shows . |
| Approach: | They show that fine-tuning improves the task of hate speech counter-narrative generation . they provide a subset of arguments and a good base model is required for the fine-uning to have a positive impact. |
| Outcome: | The proposed model produces counter-narratives that are as satisfactory as the whole set. |
Argument Mining with Fine-Tuned Large Language Models (2025.coling-main)
Copied to clipboard
| Challenge: | Argument Mining (AM) pipelines use fine-tuned large language models (LLMs) . initial approaches employ supervised machine learning algorithms, such as Maximum Entropy classifiers and Logistic Regressions. |
| Approach: | They propose to model the three main AM sub-tasks as text generation tasks and fine-tune eight popular quantized and non-quantized large language models (LLMs) on the benchmark PE, AbstRCT, and CDCP datasets. |
| Outcome: | The proposed pipeline achieves state-of-the-art across all AM sub-tasks and datasets, showing significant improvements over previous benchmarks. |
Automatic Evaluation of Attribution by Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Generative large language models (LLMs) incorporate external references to generate and support claims. however, evaluating the attribution remains an open problem. |
| Approach: | They investigate automatic evaluation of attribution given by large language models . they define different types of attributed errors and then explore two approaches . |
| Outcome: | The proposed methods highlight promising signals and challenges. |
MultiFC: A Real-World Multi-Domain Dataset for Evidence-Based Fact Checking of Claims (D19-1)
Copied to clipboard
Isabelle Augenstein, Christina Lioma, Dongsheng Wang, Lucas Chaves Lima, Casper Hansen, Christian Hansen, Jakob Grue Simonsen
| Challenge: | Existing efforts to verify factual claims are limited by small datasets or artificially constructed datasets. |
| Approach: | They propose to use the largest publicly available dataset of naturally occurring factual claims for automatic claim verification. |
| Outcome: | The proposed model outperforms baseline models and evidence pages significantly. |