Challenge: Existing interpretable detectors are not aligned with the human decision-making process and fail to offer evidence that users easily understand.
Approach: They propose an interpretable detection approach that checks whether a text is human-written or LLM-generated by checking whether it shares more similar spans with human-generated texts.
Outcome: ExaGPT outperforms interpretable detectors by +37.0 points at a false positive rate of 1%.

Similar Papers

LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection (2024.emnlp-demo)

Copied to clipboard

Challenge: a large number of machine-generated texts are often hard to distinguish between human-written and machine-generated text . this raises concerns about potential misuse, especially within educational and academic domains .
Approach: They propose a system that can detect whether a text is human-written or machine-generated . they use a fine-grained classification schema to identify the use of machine-generated text .
Outcome: The proposed system can distinguish between human-written and machine-generated text . it can detect attempts to obfuscate the fact that a text was machine- generated .
MAGE: Machine-generated Text Detection in the Wild (2024.acl-long)

Copied to clipboard

Challenge: Existing research has focused on evaluating detection methods for specific domains or language models.
Approach: They build a testbed to detect texts from diverse human writings and LLMs using different detection methods.
Outcome: Empirical results show that the top performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios.
GigaCheck: Detecting LLM-generated Content via Object-Centric Span Localization (2026.findings-acl)

Copied to clipboard

Challenge: GigaCheck is a framework for AI-generated text detection.
Approach: They propose a dual-strategy framework for AI-generated text detection . they leverage representation learning of fine-tuned LLMs to discern authorship .
Outcome: The proposed framework can detect LLM-generated content with high accuracy and accuracy . it can be used in mixed-authorship scenarios and in academic collaborations .
Machine-generated text detection prevents language model collapse (2025.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) are increasingly prevalent across the web, resulting in a degenerative process whereby LLMs reinforce their own errors and reduce output diversity.
Approach: They propose to use machine-generated text to reduce model collapse by up-sampling likely human content in training data.
Outcome: The proposed approach prevents model collapse and improves performance compared to training on purely human data.
HLU: Human Vs LLM Generated Text Detection Dataset for Urdu at Multiple Granularities (2025.coling-main)

Copied to clipboard

Challenge: Using large language models (LLMs) to generate human-like text has raised concerns about misuse, especially in low-resource languages like Urdu.
Approach: They propose a dataset that contains documents, paragraphs, and sentences . they conducted human evaluations and automated evaluations .
Outcome: The proposed dataset shows that distinguishing between human and machine-generated text is challenging for both humans and LLMs.
A Survey on Detection of LLMs-Generated Content (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in large language models have led to an increase in synthetic content generation . the ability to detect LLMs-generated content has become of paramount importance .
Approach: They propose to provide a detailed overview of existing detection strategies and benchmarks, scrutinizing their differences and advocating for more adaptable and robust models to enhance detection accuracy.
Outcome: The proposed model will be able to detect human-written content in real time.
Beyond Checkmate: Exploring the Creative Choke Points for AI Generated Texts (2025.emnlp-main)

Copied to clipboard

Challenge: Recent work on detecting LLM-generated text (AI text) has raised concerns about potential misuse . a new study examines the nuanced distinctions between human and AI texts .
Approach: They analyze human-AI text differences across body, intro, conclusion segments . human texts exhibit greater stylistic variation across segments, they show .
Outcome: The findings will inform their viability and boundaries as effective creative assistants to humans.
Efficient Detection of LLM-generated Texts with a Bayesian Surrogate Model (2024.findings-acl)

Copied to clipboard

Challenge: Large language models can be used to produce text that is coherent, well-written, and persuasive . some individuals have misused LLMs for nefarious purposes, such as creating fake news articles or engaging in cheating .
Approach: They propose to incorporate a Bayesian surrogate model to improve query efficiency . they propose to select typical samples based on Bayes' uncertainty and interpolate scores .
Outcome: The proposed method significantly outperforms existing approaches under a low query budget.
Detecting Machine-Generated Long-Form Content with Latent-Space Variables (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing zero-shot methods to distinguish machine-generated long-form texts from humans are vulnerable to domain shift including different decoding strategies, variations in prompts, and attacks.
Approach: They propose a method that incorporates abstract elements as key deciding factors by training a latent-space model on sequences of events or topics derived from human-written texts.
Outcome: The proposed method improves on baselines on three domains and significantly improves over existing methods.
People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text (2025.acl-long)

Copied to clipboard

Challenge: Qualitative analysis of experts’ free-form explanations shows that while they rely heavily on specific lexical clues (‘AI vocabulary’), they also pick up on more complex phenomena within the text (e.g., formality, originality, clarity).
Approach: They hire annotators to read 300 non-fiction English articles, label them as either human-written or AI-generated, and provide paragraph-length explanations for their decisions.
Outcome: The annotators who frequently use LLMs for writing tasks outperform commercial and open-source detectors even without evasion tactics like paraphrasing and humanization.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations