Papers by Michele Papucci
Stress-testing Machine Generated Text Detection: Shifting Language Models Writing Style to Fool Detectors (2025.findings-acl)
Copied to clipboard
Andrea Pedrotti, Michele Papucci, Cristiano Ciaccio, Alessio Miaschi, Giovanni Puccetti, Felice Dell’Orletta, Andrea Esuli
| Challenge: | Recent advances in Generative AI and Large Language Models (LLMs) have enabled the creation of highly realistic synthetic content, raising concerns about the potential for malicious use, such as misinformation and manipulation. |
| Approach: | They evaluate the resilience of state-of-the-art MGT detectors to linguistically informed adversarial attacks by using Direct Preference Optimization to shift the MGT style toward human-written text. |
| Outcome: | The proposed pipeline fine-tunes language models to shift the MGT style toward human-written text (HWT) it obtains generations more challenging to detect by current models, and shows that detectors can be easily fooled with relatively few examples, resulting in a significant drop in detecting performances. |