CoCoNUTS: Concentrating on Content while Neglecting Uninformative Textual Styles for AI-Generated Peer Review Detection (2026.acl-long)
Copied to clipboard
| Challenge: | Existing detectors rely on stylistic cues to distinguish between surface-level language refinement and genuine content generation. |
| Approach: | They propose a content-based detection paradigm to detect substantive AI-generation . they propose 'CoCoDet' detector that can detect surface-level language refinement . |
| Outcome: | The proposed detector achieves a macro F1 score of 98.24% on permissible machine-polished reviews and maintains 3.89% false positive rate on real-world reviews. |
Similar Papers
MixRevDetect: Towards Detecting AI-Generated Content in Hybrid Peer Reviews. (2025.naacl-short)
Copied to clipboard
| Challenge: | Existing methods for detecting fully AI-generated peer reviews fail to detect finer-grained AI-generated points within mixed-authorship reviews. |
| Approach: | They propose a method to identify AI-generated points in peer reviews using large language models . their approach achieved an F1 score of 88.86%, significantly outperforming existing methods . |
| Outcome: | The proposed method outperforms existing methods in identifying AI-generated points in peer reviews. |
Almost AI, Almost Human: The Challenge of Detecting AI-Polished Writing (2025.findings-acl)
Copied to clipboard
| Challenge: | a growing use of large language models (LLMs) has led to concerns about AI-generated content detection. |
| Approach: | They evaluate 12 state-of-the-art AI-text detectors using a dataset refined at varying levels of AI involvement. |
| Outcome: | The proposed detectors flag even minimally polished text as AI-generated, struggle to differentiate between degrees of AI involvement, and exhibit biases against older and smaller models. |
A Practical Examination of AI-Generated Text Detectors for Large Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods to detect large language models are prone to misuse, such as generating fake news articles, facilitating academic plagiarism or spamming. |
| Approach: | They evaluate several popular detectors to evaluate their effectiveness against a range of domains, datasets, and models. |
| Outcome: | The proposed methods perform poorly in certain settings, with TPR@.01 as low as 0%. |
Automatic Detection of Machine Generated Text: A Critical Survey (2020.coling-main)
Copied to clipboard
| Challenge: | Current text generative models excel in producing text that matches the style of human language reasonably well. |
| Approach: | They conduct an in-depth error analysis of the state-of-the-art detector and discuss research directions to guide future work in this exciting area. |
| Outcome: | The proposed detectors can distinguish between human and text generated by the model and can be used to generate fake news and fake product reviews. |
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack (2024.lrec-main)
Copied to clipboard
| Challenge: | Despite the development of large language models, there are still significant challenges in detecting whether text is generated by a machine. |
| Approach: | They propose a framework for a broader class of adversarial attacks to perform minor perturbations in machine-generated content to evade detection. |
| Outcome: | The proposed framework can be compromised in as little as 10 seconds, and improves over iterative adversarial learning. |
Who Writes What: Unveiling the Impact of Author Roles on AI-generated Text Detection (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) require accurate text detection, but authors' characteristics are neglected. |
| Approach: | They investigate how author characteristics impact AI-generated text detection . they use corpus of human-authored texts and parallel AI-generated texts . |
| Outcome: | The results show that gender, CEFR proficiency, academic field and language environment influence detector accuracy. |
Position Paper: How Should We Responsibly Adopt LLMs in the Peer Review Process? (2026.findings-eacl)
Copied to clipboard
| Challenge: | a recent paper criticizes the current use of Large Language Models (LLMs) for simple review text generation. |
| Approach: | They propose to use Large Language Models to support key aspects of the review process . they argue that this approach overlooks more meaningful applications of LLMs . authors argue that the increased reviewing burden per reviewer is a factor . |
| Outcome: | The proposed approach would support reproducibility, correctness and relevance of citations and ethics review flagging. |
LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection (2024.emnlp-demo)
Copied to clipboard
Mervat Abassy, Kareem Elozeiri, Alexander Aziz, Minh Ta, Raj Tomar, Bimarsha Adhikari, Saad Ahmed, Yuxia Wang, Osama Mohammed Afzal, Zhuohan Xie, Jonibek Mansurov, Ekaterina Artemova, Vladislav Mikhailov, Rui Xing, Jiahui Geng, Hasan Iqbal, Zain Mujahid, Tarek Mahmoud, Akim Tsvigun, Alham Aji, Artem Shelmanov, Nizar Habash, Iryna Gurevych, Preslav Nakov
| Challenge: | a large number of machine-generated texts are often hard to distinguish between human-written and machine-generated text . this raises concerns about potential misuse, especially within educational and academic domains . |
| Approach: | They propose a system that can detect whether a text is human-written or machine-generated . they use a fine-grained classification schema to identify the use of machine-generated text . |
| Outcome: | The proposed system can distinguish between human-written and machine-generated text . it can detect attempts to obfuscate the fact that a text was machine- generated . |
Navigating the Shadows: Unveiling Effective Disturbances for Modern AI Content Detectors (2024.acl-long)
Copied to clipboard
| Challenge: | Recent research indicates that AI-text detection systems lack robustness and struggle to effectively differentiate perturbed texts. |
| Approach: | They propose to evaluate the robustness of current detection systems by using black-box text perturbation methods and adversarial learning experiments. |
| Outcome: | The proposed methods assess the robustness of current detection models across perturbation granularities and the impact of perturbation data augmentation on the robustity of AI-text detectors. |
People who frequently use ChatGPT for writing tasks are accurate and robust detectors of AI-generated text (2025.acl-long)
Copied to clipboard
| Challenge: | Qualitative analysis of experts’ free-form explanations shows that while they rely heavily on specific lexical clues (‘AI vocabulary’), they also pick up on more complex phenomena within the text (e.g., formality, originality, clarity). |
| Approach: | They hire annotators to read 300 non-fiction English articles, label them as either human-written or AI-generated, and provide paragraph-length explanations for their decisions. |
| Outcome: | The annotators who frequently use LLMs for writing tasks outperform commercial and open-source detectors even without evasion tactics like paraphrasing and humanization. |