Do We Need Language-Specific Fact-Checking Models? The Case of Chinese (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing fact-checking models in other languages lack grounding in real-world claims . current models are constrained to a single domain, like COVID-19 . |
| Approach: | They propose a Chinese document-level evidence retriever that can be translated into Chinese . they then construct an adversarial dataset that is more robust toward biases . |
| Outcome: | The proposed method outperforms translation-based methods and multilingual language models and is more robust toward biases. |
Similar Papers
CHEF: A Pilot Chinese Dataset for Evidence-Based Fact-Checking (2022.naacl-main)
Copied to clipboard
| Challenge: | CHEF dataset provides evidence retrieval over non-English claims . e-fact-checking is a time-consuming task, which can take journalists several hours or days. |
| Approach: | They construct a dataset of 10K real-world claims that is based on annotated evidence retrieved from the Internet. |
| Outcome: | The proposed dataset provides evidence retrieval as a latent variable and can be used to train and reason over non-English claims. |
Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detection (2026.eacl-long)
Copied to clipboard
Ivan Vykopal, Antonia Karamolegkou, Jaroslav Kopčan, Qiwei Peng, Tomáš Javůrek, Michal Gregor, Marian Simko
| Challenge: | Recent advances in multilingual Large Language Models have enabled powerful capabilities for cross-lingual fact-checking. |
| Approach: | They evaluate six open-source multilingual LLMs across 20 languages using a fully multilingual prompting strategy. |
| Outcome: | The proposed model performs better on high-resource languages than on low-resourced ones. |
Large Language Models for Multilingual Previously Fact-Checked Claim Detection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new study evaluates large language models for multilingual previously fact-checked claim detection . authors assess seven LLMs across 20 languages in monolingual and cross-lingual settings . |
| Approach: | They evaluate large language models for multilingual previously fact-checked claim detection . they find they perform well for high-resource languages, struggle with low-resourced languages . |
| Outcome: | The proposed model performs well for high-resource languages, but struggle with low-resourced languages. |
X-Fact: A New Benchmark Dataset for Multilingual Fact Checking (2021.acl-short)
Copied to clipboard
| Challenge: | Several fact-checking initiatives, such as PolitiFact, expend manual labor to investigate and determine the truthfulness of viral statements. |
| Approach: | They propose a multilingual dataset for factual verification of naturally existing claims . they use a benchmark to evaluate the multilingual models . |
| Outcome: | The proposed model achieves an F-score of around 40%, suggesting it is a challenging benchmark for multilingual fact-checking models. |
Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approaches (2025.emnlp-main)
Copied to clipboard
| Challenge: | Previous work has mostly tackled the task monolingually, i.e., having both the input and the retrieved claims in the same language. |
| Approach: | They examine strategies to improve multilingual and crosslingual performance by selecting negative examples and re-ranking. |
| Outcome: | The proposed methods improve performance on a multilingual and crosslingual dataset. |
TruthTrap: A Bilingual Benchmark for Evaluating Factually Correct Yet Misleading Information in Question Answering (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly used to answer factual, information-seeking questions (ISQs). |
| Approach: | They propose to use a dataset to evaluate large language models to generate human-like text on ISQs in two languages, English and Farsi, and then use it to evaluate nine LLMs. |
| Outcome: | The proposed dataset shows that accuracy drops by 25% when models encounter misleading yet factual hints. |
MedFact: A Large-scale Chinese Dataset for Evidence-based Medical Fact-checking of LLM Responses (2025.emnlp-main)
Copied to clipboard
Tong Chen, Zimu Wang, Yiyi Miao, Haoran Luo, Sun Yuanfei, Wei Wang, Zhengyong Jiang, Procheta Sen, Jionglong Su
| Challenge: | Existing medical fact-checking datasets focus on human-generated content, leaving the verification of content generated by large language models (LLMs) relatively unexplored. |
| Approach: | They propose to use Chinese medical fact-checking datasets to verify LLM-generated medical content by combining in-context learning and fine-tuning. |
| Outcome: | The first evidence-based Chinese medical fact-checking dataset of LLM-generated medical content consists of 1,321 questions and 7,409 claims . |
A Chinese Dataset for Evaluating the Safeguards in Large Language Models (2024.findings-acl)
Copied to clipboard
Yuxia Wang, Zenan Zhai, Haonan Li, Xudong Han, Shom Lin, Zhenxuan Zhang, Angela Zhao, Preslav Nakov, Timothy Baldwin
| Challenge: | a recent study has shown that large language models can produce harmful responses, exposing users to unexpected risks. |
| Approach: | They propose a dataset for the safety evaluation of Chinese LLMs in Mandarin Chinese . they extend the dataset to better identify false negative and false positive examples . |
| Outcome: | The proposed dataset is for the safety evaluation of Chinese LLMs, and is based on a Chinese dataset. |
Comparing Biases and the Impact of Multilingual Training across Multiple Languages (2023.emnlp-main)
Copied to clipboard
Sharon Levy, Neha John, Ling Liu, Yogarshi Vyas, Jie Ma, Yoshinari Fujinuma, Miguel Ballesteros, Vittorio Castelli, Dan Roth
| Challenge: | Currently, studies on bias and fairness in natural language processing focus on a single language and/or across few attributes (e.g. gender, race). However, biases can manifest differently across languages for individual attributes. |
| Approach: | They adapt existing sentiment bias templates in English to Italian, Chinese, Hebrew, and Spanish for race, religion, nationality, and gender. |
| Outcome: | The proposed model favors groups that are dominant in each language's culture, indicating bias amplification, after multilingual finetuning. |
A Survey on Automated Fact-Checking (2022.tacl-1)
Copied to clipboard
| Challenge: | Fact-checking is an essential task in journalism due to the speed with which information and misinformation can spread in the media ecosystem. |
| Approach: | They propose to use natural language processing to automate fact-checking by identifying common concepts and defining definitions. |
| Outcome: | The proposed method can predict the veracity of claims using natural language processing, machine learning, and databases. |