Investigating Language and Retrieval Bias in Multilingual Previously Fact-Checked Claim Detection (2026.eacl-long)
Copied to clipboard
Ivan Vykopal, Antonia Karamolegkou, Jaroslav Kopčan, Qiwei Peng, Tomáš Javůrek, Michal Gregor, Marian Simko
| Challenge: | Recent advances in multilingual Large Language Models have enabled powerful capabilities for cross-lingual fact-checking. |
| Approach: | They evaluate six open-source multilingual LLMs across 20 languages using a fully multilingual prompting strategy. |
| Outcome: | The proposed model performs better on high-resource languages than on low-resourced ones. |
Similar Papers
Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approaches (2025.emnlp-main)
Copied to clipboard
| Challenge: | Previous work has mostly tackled the task monolingually, i.e., having both the input and the retrieved claims in the same language. |
| Approach: | They examine strategies to improve multilingual and crosslingual performance by selecting negative examples and re-ranking. |
| Outcome: | The proposed methods improve performance on a multilingual and crosslingual dataset. |
Large Language Models for Multilingual Previously Fact-Checked Claim Detection (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new study evaluates large language models for multilingual previously fact-checked claim detection . authors assess seven LLMs across 20 languages in monolingual and cross-lingual settings . |
| Approach: | They evaluate large language models for multilingual previously fact-checked claim detection . they find they perform well for high-resource languages, struggle with low-resourced languages . |
| Outcome: | The proposed model performs well for high-resource languages, but struggle with low-resourced languages. |
Multilingual Previously Fact-Checked Claim Retrieval (2023.emnlp-main)
Copied to clipboard
Matúš Pikuliak, Ivan Srba, Robert Moro, Timo Hromadka, Timotej Smoleň, Martin Melišek, Ivan Vykopal, Jakub Simko, Juraj Podroužek, Maria Bielikova
| Challenge: | Fact-checkers are often hampered by the sheer amount of online content that needs to be fact-checked. |
| Approach: | They propose a multilingual dataset for previously fact-checked claim retrieval using social media posts and 206k fact- checks in 39 languages written by professional fact- checkers. |
| Outcome: | The proposed method improves on the previously unsupervised method and shows that a multilingual dataset has its complexities and needs to be carefully interpreted. |
All Languages Matter: Understanding and Mitigating Language Bias in Multilingual RAG (2026.acl-long)
Copied to clipboard
Dan Wang, Guozhao Mo, Yafei Shi, Cheng Zhang, Bo Zheng, Boxi Cao, Xuanang Chen, Yaojie Lu, Hongyu Lin, Ben He, Xianpei Han, Le Sun
| Challenge: | Existing mRAG systems suffer from a language bias during reranking, systematically favoring English and the query’s native language. |
| Approach: | They propose a language-agnostic utility-driven reranker alignment technique to mitigate language bias during re-ranking. |
| Outcome: | The proposed approach mitigates language bias and consistently improves mRAG performance across languages. |
7 Points to Tsinghua but 10 Points to ? Assessing Large Language Models in Agentic Multilingual National Bias (2025.findings-acl)
Copied to clipboard
| Challenge: | Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, but studies on risks associated with cross biases are limited to immediate context preferences. |
| Approach: | They investigate multilingual bias in state-of-the-art Large Language Models by analyzing their responses to decision-making tasks across multiple languages. |
| Outcome: | The proposed model can provide personalized advice across university applications, travel, and relocation scenarios. |
Mind the Gap: Multilingual Divide in LLM Bias Detection and Reasoning (2026.acl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are increasingly deployed in multilingual settings . but most bias evaluation remains English-centric and ignores how bias manifests within reasoning . |
| Approach: | They evaluate large language models with supervised fine-tuning and preference optimization . they find that bias varies substantially across languages, with consistent degradation in non-English settings . |
| Outcome: | The proposed model improves in English, Dutch, Spanish, and Turkish using the MBBQ benchmark. |
Faux Polyglot: A Study on Information Disparity in Multilingual Large Language Models (2025.naacl-long)
Copied to clipboard
| Challenge: | Recent surge in multilingual large language models (LLMs) and Retrieval Augmented Generation (RAG) has significantly expanded conversational search across varied linguistic and cultural demographics. |
| Approach: | They found that LLMs displayed systemic bias towards information in the same language as query language in document retrieval and answer generation. |
| Outcome: | The results highlight the linguistic divide within multilingual LLMs in information search systems. |
Entity-aware Cross-lingual Claim Detection for Automated Fact-checking (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing work on verifiable claims detection is focused on monolingual solutions . identifying and validating claims related to global concerns requires a fact-checking pipeline capable of processing claims written in multiple languages. |
| Approach: | They propose an entity-aware cross-lingual claim detection model that generalizes well to handle multilingual claims. |
| Outcome: | The proposed model shows consistent performance gains across 27 languages and robust knowledge transfer between languages seen and unseen during training. |
Multilingual and Cross-Lingual Citation Needed Detection on Wikipedia for Lower-Resource Languages (2026.acl-long)
Copied to clipboard
| Challenge: | Existing research has largely overlooked lower-resource languages for automated fact-checking. |
| Approach: | They propose a multilingual CND corpus spanning 18 languages across three resource levels and a small decoder-based language model for CND. |
| Outcome: | The proposed model outperforms prompted LLMs in cross-lingual CND across languages. |
MultiClaimNet: A Massively Multilingual Dataset of Fact-Checked Claim Clusters (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a growing number of unverified claims and expanding size of fact-checked databases require alternative, more efficient solutions. |
| Approach: | They propose to group fact-checked claims into multilingual clusters to improve claim retrieval and validation. |
| Outcome: | The proposed approach reduces redundancy by grouping claims into clusters . the proposed dataset contains 85.3K fact-checked claims written in 78 languages . |