Profiler: Black-box AI-generated Text Origin Detection via Context-aware Inference Pattern Analysis (2025.emnlp-main)
Copied to clipboard
Hanxi Guo, Siyuan Cheng, Xiaolong Jin, Zhuo Zhang, Guangyu Shen, Kaiyuan Zhang, Shengwei An, Guanhong Tao, Xiangyu Zhang
| Challenge: | Existing methods to identify the origin of AI-generated texts fail to identify origin due to the high similarity of different LLMs. |
| Approach: | They propose a black-box AI-generated text origin detection method which accurately predicts the origin of an input text by extracting distinct context inference patterns. |
| Outcome: | The proposed method outperforms 10 state-of-the-art baselines and achieves a 25% increase in AUC score on average across natural language and code datasets. |
Similar Papers
Where Am I From? Identifying Origin of LLM-generated Content (2024.emnlp-main)
Copied to clipboard
| Challenge: | Generative models have produced high-quality content, but they pose security risks . a new framework for deep learning systems enables the tracing of AI-generated content back to its source . |
| Approach: | They propose a digital forensics framework that embeds a secret watermark into the generated output and a "depth watermark" this watermark strengthens the link between content and generator, enabling accurate tracing while maintaining the quality of the generated content. |
| Outcome: | The proposed framework ensures accurate tracing while maintaining quality of generated content. |
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection (2024.eacl-long)
Copied to clipboard
Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Chenxi Whitehouse, Osama Mohammed Afzal, Tarek Mahmoud, Toru Sasaki, Thomas Arnold, Alham Aji, Nizar Habash, Iryna Gurevych, Preslav Nakov
| Challenge: | Large language models generate fluent responses to user queries, but they are also susceptible to misuse in journalism, education, and academia. |
| Approach: | They propose a large-scale benchmark for machine-generated text detection that is a multi-generator, multi-domain, and multi-lingual corpus. |
| Outcome: | The proposed system can detect machine-generated text and pinpoint misuse . the proposed system is based on a large-scale benchmark dataset . |
DART: An AIGT Detector using AMR of Rephrased Text (2025.naacl-short)
Copied to clipboard
| Challenge: | Existing methods for detecting AIGTs focus on probabilistic features, causing problems . performance of black-box detectors is low, and it is difficult to detect black- box models . |
| Approach: | They propose a detector that can discriminate multiple black-box LLMs without probabilistic features and the origin of AIGT. |
| Outcome: | The proposed method can discriminate multiple black-box LLMs without probabilistic features and the origin of AIGT. |
Enhancing LLM Text Detection with Retrieved Contexts and Logits Distribution Consistency (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting large language models (LLMs) generate fluent text, but they only use a few tokens due to the short length or insufficient information in some texts. |
| Approach: | They propose a method that leverages external text corpora to evaluate the difference in logit distribution of input text under retrieved human-written and LLM-rewritten contexts. |
| Outcome: | The proposed method achieves state-of-the-art performance in AUROC on five public datasets with three widely-used source LLMs. |
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)
Copied to clipboard
Xianjun Yang, Liangming Pan, Xuandong Zhao, Haifeng Chen, Linda Petzold, William Yang Wang, Wei Cheng
| Challenge: | Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance . |
| Approach: | They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy. |
| Outcome: | The proposed model will be able to detect human-written content in real time. |
RAGulator: Lightweight Out-of-Context Detectors for Grounded Text Generation (2025.emnlp-industry)
Copied to clipboard
| Challenge: | In enterprise settings, Generative AI has received widespread adoption as a tool to uplift employees' productivity. |
| Approach: | They develop lightweight models capable of detecting when LLM-generated text deviates from retrieved source documents semantically. |
| Outcome: | The proposed models outperform open-source alternatives on credit policy and sustainability reports used in the banking industry. |
Automatic Detection of Machine Generated Text: A Critical Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Current text generative models excel in producing text that matches the style of human language reasonably well. |
| Approach: | They conduct an in-depth error analysis of the state-of-the-art detector and discuss research directions to guide future work in this exciting area. |
| Outcome: | The proposed detectors can distinguish between human and text generated by the model and can be used to generate fake news and fake product reviews. |
AIDER: a Robust and Topic-Independent Framework for Detecting AI-Generated Text (2025.coling-main)
Copied to clipboard
| Challenge: | Current fine-tuned detectors lack robustness against adversarial attacks and struggle with out-of-distribution topics, limiting their practical applicability. |
| Approach: | They propose a topic-independent framework for detecting AI-generated text . it leverages the ALBERT model for topic content disentanglement, enhancing transferability to unseen topics. |
| Outcome: | The proposed framework outperforms state-of-the-art methods in detecting human-written and AI-generated content under adversarial and topic-varied conditions. |
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack (2024.lrec-main)
Copied to clipboard
| Challenge: | Despite the development of large language models, there are still significant challenges in detecting whether text is generated by a machine. |
| Approach: | They propose a framework for a broader class of adversarial attacks to perform minor perturbations in machine-generated content to evade detection. |
| Outcome: | The proposed framework can be compromised in as little as 10 seconds, and improves over iterative adversarial learning. |
Text Fluoroscopy: Detecting LLM-Generated Text through Intrinsic Features (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized the field of natural language processing because of their excellent performance on various tasks. |
| Approach: | They propose a black-box method with better generalizability for detecting LLM-generated text by mining the intrinsic features of the text to be detected. |
| Outcome: | The proposed method achieves 7.36% and 2.84% improvement in detection performance compared to baselines in detecting texts from different domains generated by GPT-4 and Claude3 respectively. |