Empowering the Fact-checkers! Automatic Identification of Claim Spans on Twitter (2022.emnlp-main)
Copied to clipboard
| Challenge: | Current vogue is to employ manual fact-checkers to efficiently classify and verify such data to combat this avalanche of misinformation and fake news. |
| Approach: | They propose a large-scale Twitter corpus with token-level claim spans on more than 7.5k tweets and a model that automatically detects and extracts the snippets of misinformation. |
| Outcome: | The proposed model outperforms baseline systems on several evaluation metrics, improving by 1.5 points. |
Similar Papers
Lost in Translation, Found in Spans: Identifying Claims in Multilingual Social Media (2023.emnlp-main)
Copied to clipboard
| Challenge: | Claim span identification (CSI) is an important step in fact-checking pipelines . despite its importance to journalists and fact-seekers, it remains a understudied problem . |
| Approach: | They propose to use social media claims to identify text segments that contain a check-worthy claim or assertion in a social media post. |
| Outcome: | The proposed dataset outperforms other cross-lingual transfer methods on multiple languages. |
COVID-19 Claim Radar: A Structured Claim Extraction and Tracking System (2022.acl-demo)
Copied to clipboard
Manling Li, Revanth Gangi Reddy, Ziqi Wang, Yi-shyuan Chiang, Tuan Lai, Pengfei Yu, Zixuan Zhang, Heng Ji
| Challenge: | a new system extracts supporting and refuting claims from COVID-19 related news . the system is publicly available at GitHub and DockerHub, with complete documentation. |
| Approach: | They propose a COVID-19 Claim Radar system that extracts supporting and refuting claims . the system leverages Wikidata as the hub to consolidate coreferential knowledge elements . |
| Outcome: | The system extracts supporting and refuting claims from COVID-19 pandemic information . it leverages Wikidata as the hub to merge coreferential knowledge elements . |
Harnessing Abstractive Summarization for Fact-Checked Claim Detection (2022.coling-1)
Copied to clipboard
| Challenge: | Social media platforms are becoming battlegrounds for anti-social elements . fact-checking organizations cannot cope with the rapid dissemination of misinformation . a new workflow for fact- checking can be implemented to reduce human time for tasks with high cognition . |
| Approach: | They propose a workflow for detecting previously fact-checked claims that uses abstractive summarization to generate crisp queries. |
| Outcome: | The proposed workflow achieves Recall@5 and MRR of 35% and 0.3, respectively. |
CoVERT: A Corpus of Fact-checked Biomedical COVID-19 Tweets (2022.lrec-1)
Copied to clipboard
| Challenge: | Existing fact-checking resources cover COVID-19 related information in news, but there is no dataset providing fact- checked COVId-19 related tweets with detailed annotations for biomedical entities, relations and relevant evidence. |
| Approach: | They propose a fact-checked corpus of tweets with annotations for biomedical entities, relations and relevant evidence for COVID-19 related tweets. |
| Outcome: | The proposed dataset provides fact-checked COVID-19 related tweets with detailed annotations for biomedical entities, relations and relevant evidence. |
Fighting the COVID-19 Infodemic: Modeling the Perspective of Journalists, Fact-Checkers, Social Media Platforms, Policy Makers, and the Society (2021.findings-emnlp)
Copied to clipboard
Firoj Alam, Shaden Shaar, Fahim Dalvi, Hassan Sajjad, Alex Nikolov, Hamdy Mubarak, Giovanni Da San Martino, Ahmed Abdelali, Nadir Durrani, Kareem Darwish, Abdulaziz Al-Homaid, Wajdi Zaghouani, Tommaso Caselli, Gijs Danoe, Friso Stolk, Britt Bruntink, Preslav Nakov
| Challenge: | a dataset of 16K manually annotated tweets is used to analyze disinformation . the democratic nature of social media has raised questions about the quality and the factuality of the information that is shared on these platforms. |
| Approach: | They use a dataset of manually annotated tweets to analyze COVID-19 disinformation . they show that tweets contain fake cures, rumors, conspiracy theories and xenophobia . |
| Outcome: | The proposed dataset shows that it is useful in monolingual vs. multilingual settings. |
Human-in-the-loop Evaluation for Early Misinformation Detection: A Case Study of COVID-19 Treatments (2023.acl-long)
Copied to clipboard
| Challenge: | Existing evaluations of human-in-the-loop systems to combat misinformation are often set up automatically using datasets that were retrospectively constructed. |
| Approach: | They propose a human-in-the-loop evaluation framework for fact-checking novel misinformation claims and identifying social media messages that support them. |
| Outcome: | The proposed framework is based on modern NLP methods for human-in-the-loop fact-checking in the domain of COVID-19 treatments. |
MUDES: Multilingual Detection of Offensive Spans (2021.naacl-demos)
Copied to clipboard
| Challenge: | Identifying offensive spans in texts is the goal of the SemEval-2021 Task 5: Toxic Spans Detection . previous work focused on post level annotations, but identifying offensive span is useful in many ways. |
| Approach: | They propose a Python-based system to detect offensive spans in texts with pre-trained models and a user-friendly web-based interface. |
| Outcome: | The proposed system is based on a Python-based framework and a user-friendly web-based interface. |
ClaimPortal: Integrated Monitoring, Searching, Checking, and Analytics of Factual Claims on Twitter (P19-3)
Copied to clipboard
Sarthak Majithia, Fatma Arslan, Sumeet Lubal, Damian Jimenez, Priyank Arora, Josue Caraballo, Chengkai Li
| Challenge: | ClaimPortal is a web-based platform for monitoring, searching, checking and analyzing factual claims on Twitter from the American political domain. |
| Approach: | They present a web-based platform for monitoring, searching, checking and analyzing English factual claims on Twitter from the American political domain. |
| Outcome: | The proposed platform can monitor, search, check, and analyze English factual claims on Twitter from the political domain. |
WIKIBIAS: Detecting Multi-Span Subjective Biases in Language (2021.findings-emnlp)
Copied to clipboard
| Challenge: | a particular type of bias is subjective bias, which introduces improper attitudes or presents a statement with the presupposition of truth. |
| Approach: | They propose to annotate a Wikipedia edits corpus with 4,000 sentence pairs to detect subjective bias. |
| Outcome: | The proposed dataset can be used as a research benchmark and generalize to multiple domains. |
Assisting the Human Fact-Checkers: Detecting All Previously Fact-Checked Claims in a Document (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent years have brought us a proliferation of false claims online, which spread fast . fact-checkers have been using automated fact-finding to verify claims . |
| Approach: | They propose a system that can detect claims that can be fact-checked by a given database . they create a manually annotated document dataset and propose evaluation measures . |
| Outcome: | The proposed system achieves sizable performance gains over strong baselines. |