Papers by Robert Moro
MULTITuDE: Large-Scale Multilingual Machine-Generated Text Detection Benchmark (2023.emnlp-main)
Copied to clipboard
Dominik Macko, Robert Moro, Adaku Uchendu, Jason Lucas, Michiharu Yamashita, Matúš Pikuliak, Ivan Srba, Thai Le, Dongwon Lee, Jakub Simko, Maria Bielikova
| Challenge: | MULTITuDE benchmarks lack authentic and machine-generated text in languages other than English . defining characteristic of new generation of LLMs is increased quality of text . |
| Approach: | They propose a benchmarking dataset for multilingual machine-generated text detection that compares detectors with authentic and machine-generated texts in 11 languages. |
| Outcome: | The proposed dataset compares detectors with zero-shot and fine-tuned detectors in 11 languages. |
Multilingual Previously Fact-Checked Claim Retrieval (2023.emnlp-main)
Copied to clipboard
Matúš Pikuliak, Ivan Srba, Robert Moro, Timo Hromadka, Timotej Smoleň, Martin Melišek, Ivan Vykopal, Jakub Simko, Juraj Podroužek, Maria Bielikova
| Challenge: | Fact-checkers are often hampered by the sheer amount of online content that needs to be fact-checked. |
| Approach: | They propose a multilingual dataset for previously fact-checked claim retrieval using social media posts and 206k fact- checks in 39 languages written by professional fact- checkers. |
| Outcome: | The proposed method improves on the previously unsupervised method and shows that a multilingual dataset has its complexities and needs to be carefully interpreted. |
MultiSocial: Multilingual Benchmark of Machine-Generated Text Detection of Social-Media Texts (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for detecting social-media texts are limited to the English language and longer texts are not easily recognisable by humans. |
| Approach: | They propose to use a multilingual and multi-platform dataset to compare machine-generated text detection methods in the social-media domain to compare them to human-written texts. |
| Outcome: | The proposed dataset contains 472,097 texts, of which about 58k are human-written and approximately the same amount is generated by each of 7 multilingual LLMs. |
Multilingual vs Crosslingual Retrieval of Fact-Checked Claims: A Tale of Two Approaches (2025.emnlp-main)
Copied to clipboard
| Challenge: | Previous work has mostly tackled the task monolingually, i.e., having both the input and the retrieved claims in the same language. |
| Approach: | They examine strategies to improve multilingual and crosslingual performance by selecting negative examples and re-ranking. |
| Outcome: | The proposed methods improve performance on a multilingual and crosslingual dataset. |
MultiCW: A Large-Scale Balanced Benchmark Dataset for Training Robust Check-Worthiness Detection Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are beginning to reshape how media professionals verify information, but support for detecting check-worthy claims remains limited. |
| Approach: | They propose a multilingual benchmark for check-worthy claim detection spanning 16 languages, six topical domains, and two writing styles. |
| Outcome: | The proposed model outperforms zero-shot LLMs on claim classification and strong generalization across languages, domains, and styles. |
Evaluation of LLM Vulnerabilities to Being Misused for Personalized Disinformation Generation (2025.acl-long)
Copied to clipboard
Aneta Zugecova, Dominik Macko, Ivan Srba, Robert Moro, Jakub Kopál, Katarína Marcinčinová, Matúš Mesarčík
| Challenge: | Recent large language models generate disinformation news articles following predefined narratives . personalization and disinformation abilities of LLMs have not been studied . |
| Approach: | They evaluate the personalization and disinformation abilities of large language models . they find personalization reduces the safety-filter activations, thus effectively functioning as a jailbreak . |
| Outcome: | The proposed model generates disinformation news articles in english with the lowest quality of personalization. |
A Ship of Theseus: Curious Cases of Paraphrasing in LLM-Generated Texts (2024.acl-long)
Copied to clipboard
Nafis Irtiza Tripto, Saranya Venkatraman, Dominik Macko, Robert Moro, Ivan Srba, Adaku Uchendu, Thai Le, Dongwon Lee
| Challenge: | Using a computational approach, we discover that diminishing performance in text classification models is closely associated with the extent of deviation from the original author’s style. |
| Approach: | They propose to use large language models to determine whether a text retains original authorship when it undergoes numerous paraphrasing iterations. |
| Outcome: | The results suggest that authorship should be task-dependent . |
Authorship Attribution in Multilingual Machine-Generated Texts (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have reached human-like fluency and coherence, but distinguishing machine-generated text from human-written content becomes increasingly difficult. |
| Approach: | They propose a problem of multilingual authorship attribution (AA) that involves attributing texts to human or multiple LLM generators across diverse languages. |
| Outcome: | The proposed method can be adapted to multilingual settings, but still has significant limitations and challenges. |
Authorship Obfuscation in Multilingual Machine-Generated Text Detection (2024.findings-emnlp)
Copied to clipboard
Dominik Macko, Robert Moro, Adaku Uchendu, Ivan Srba, Jason Lucas, Michiharu Yamashita, Nafis Irtiza Tripto, Dongwon Lee, Jakub Simko, Maria Bielikova
| Challenge: | Recent advances in Language Modeling have birthed Large Language Models (LLMs), which exhibit significant improvements, including the ability to generate texts easily misconstrued as humanwritten. |
| Approach: | They compare authorship obfuscation methods against machine-generated text (MGT) in 11 languages and analyze their performance against 37 well-known AO methods. |
| Outcome: | The proposed methods can cause evasion of detection in all languages, with homoglyph attacks particularly successful. |