| Challenge: | Social media and news sites can be flooded with synthetically generated misinformation via tweets and posts while authentic users can inadvertently spread this text via shares and retweets. |
| Approach: | They propose a method of detecting synthetically generated tweets via a Transformer architecture and incorporate unique style-based features. |
| Outcome: | The proposed method detects synthetically generated tweets using a Transformer architecture and incorporating unique style-based features. |
Similar Papers
Automatic Detection of Machine Generated Text: A Critical Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Current text generative models excel in producing text that matches the style of human language reasonably well. |
| Approach: | They conduct an in-depth error analysis of the state-of-the-art detector and discuss research directions to guide future work in this exciting area. |
| Outcome: | The proposed detectors can distinguish between human and text generated by the model and can be used to generate fake news and fake product reviews. |
When Detection Fails: The Power of Fine-Tuned Models to Generate Human-Like Social Media Text (2025.findings-acl)
Copied to clipboard
| Challenge: | detecting AI-generated text on social media is difficult due to short text length and informal language of the internet . a recent study shows that detection of AI-generated posts is difficult under assumptions that an attacker has no knowledge of the generating model . |
| Approach: | They use open-source, closed-source and fine-tuned social media to detect AI-generated text . they use assumptions about knowledge of and access to the generating models to test detection . |
| Outcome: | a human study shows that detection of AI-generated social media posts is difficult . the study compared 505,159 posts from open-source, closed-source and fine-tuned models . |
Fingerprinting Fine-tuned Language Models in the Wild (2021.findings-acl)
Copied to clipboard
| Challenge: | Existing fingerprinting methods to fingerprint language models are limited to attributing organic text . however, fine-tuned LMs can generate long, coherent, and grammatically valid synthetic text. |
| Approach: | They conduct extensive experiments to demonstrate the limitations of existing fingerprinting approaches. |
| Outcome: | The proposed fingerprinting methods are limited to attributing synthetic text generated by 10 pre-trained LMs. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
MAGE: Machine-generated Text Detection in the Wild (2024.acl-long)
Copied to clipboard
Yafu Li, Qintong Li, Leyang Cui, Wei Bi, Zhilin Wang, Longyue Wang, Linyi Yang, Shuming Shi, Yue Zhang
| Challenge: | Existing research has focused on evaluating detection methods for specific domains or language models. |
| Approach: | They build a testbed to detect texts from diverse human writings and LLMs using different detection methods. |
| Outcome: | Empirical results show that the top performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios. |
Enhancing Discourse Parsing for Local Structures from Social Media with LLM-Generated Data (2025.coling-main)
Copied to clipboard
| Challenge: | Existing discourse parsers do not generalize well across genres and text types. |
| Approach: | They propose to integrate large language models into RST discourse parsers to improve parser performance in a social media context. |
| Outcome: | The proposed model improves parser performance in a social media context without pre-identified discourse units. |
Detecting Machine-Generated Text: Techniques and Challenges (2024.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial focuses on machine-generated text and deepfakes. |
| Approach: | This tutorial aims to provide a comprehensive overview of text detection techniques . it will focus on machine-generated text and deepfakes . |
| Outcome: | This tutorial focuses on machine-generated text and deepfakes. |
Detecting AI-Generated Content on Social Media with Multi-modal Language Models (2026.acl-industry)
Copied to clipboard
Chenyang Yang, Shen Yan, Yibo Yang, Litao Hu, Yuchen Liu, Yuan Zeng, Hanchao Yu, Yinan Zhu, Sumedha Singla, Brian Vanover, Huijun Qian, Zihao Wang, Fujun Liu, Aashu Singh, Jianyu Wang, Xuewen Zhang
| Challenge: | Existing methods for AI-generated content detection face poor generalization to newer models, reliance on single modalities, and lack of interpretable explanations. |
| Approach: | They propose a model that curates diverse social media data and trains a vision-language model for detection and explanation. |
| Outcome: | The proposed model achieves state-of-the-art detection performance on public benchmarks and observes positive downstream impacts on user engagement. |
How to Generalize the Detection of AI-Generated Text: Confounding Neurons (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Linguistic and domain confounders introduce spurious correlations, leading to poor out-of-distribution (OOD) performance. |
| Approach: | They propose a novel post-hoc, neuron-level intervention framework to disentangle AI-generated text detection factors from data-specific biases. |
| Outcome: | The proposed framework reduces topic-specific biases by encoding individual neurons within transformers-based detectors rather than task-specific signals. |
LLM-as-a-Coauthor: Can Mixed Human-Written and Machine-Generated Text Be Detected? (2024.findings-naacl)
Copied to clipboard
Qihui Zhang, Chujie Gao, Dongping Chen, Yue Huang, Yixin Huang, Zhenyang Sun, Shilin Zhang, Weiye Li, Zhengyan Fu, Yao Wan, Lichao Sun
| Challenge: | Current research focuses on purely MGT detection without adequately addressing mixed scenarios including AI-revised Human-Written Text (HWT) and human-revealed MGT. |
| Approach: | They define mixtext, a form of mixed text involving both AI and human-generated content, and then use a MixSet dataset to assess their effectiveness. |
| Outcome: | The proposed detectors struggle to identify mixtext, particularly in dealing with subtle modifications and style adaptability. |