Challenge: Large language models (LLMs) have exhibited remarkable fluency across tasks, but their unethical applications are unclear.
Approach: They propose a grammar error-free black-box attack that exploits LLM embeddings at the word-level while preserving original text quality.
Outcome: The proposed attack compromises all detectors across domains and is transferable across source models.

Similar Papers

Your Language Model Can Secretly Write Like Humans: Contrastive Paraphrase Attacks on LLM-Generated Text Detectors (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to detect large language models (LLMs) generated for plagiarism use paraphrases to rewrite them to evade detection.
Approach: They propose a training-free method that effectively fools text detectors using off-the-shelf LLMs by rewriting them to evade detection.
Outcome: The proposed method deceives text detectors using off-the-shelf LLMs by rewriting them to produce human-like sentences that are less discernible by detectors.
Humanizing Machine-Generated Content: Evading AI-Text Detection through Adversarial Attack (2024.lrec-main)

Copied to clipboard

Challenge: Despite the development of large language models, there are still significant challenges in detecting whether text is generated by a machine.
Approach: They propose a framework for a broader class of adversarial attacks to perform minor perturbations in machine-generated content to evade detection.
Outcome: The proposed framework can be compromised in as little as 10 seconds, and improves over iterative adversarial learning.
MAGE: Machine-generated Text Detection in the Wild (2024.acl-long)

Copied to clipboard

Challenge: Existing research has focused on evaluating detection methods for specific domains or language models.
Approach: They build a testbed to detect texts from diverse human writings and LLMs using different detection methods.
Outcome: Empirical results show that the top performing detector can identify 84.12% out-of-domain texts generated by a new LLM, indicating the feasibility for application scenarios.
Embedding and Gradient Say Wrong: A White-Box Method for Hallucination Detection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing methods for hallucination detection have attracted more attention from the community.
Approach: They propose to model the distributional distance between the regular conditional output and the unconditional output, which is generated without a given input text.
Outcome: The proposed model achieves state-of-the-art on the hallucination benchmarks HADES and other datasets.
Stumbling Blocks: Stress Testing the Robustness of Machine-Generated Text Detectors Under Attacks (2024.acl-long)

Copied to clipboard

Challenge: Existing studies on this topic focus on the robustness of specific detectors or particular attack methods.
Approach: They stress test the detectors’ robustness to malicious attacks under realistic scenarios using LLMs and metric-based detectors.
Outcome: The proposed methods are based on a set of LLM-based models and their performance is compared under different budget levels.
Close or Cloze? Assessing the Robustness of Large Language Models to Adversarial Perturbations via Word Recovery (2025.coling-main)

Copied to clipboard

Challenge: Existing models implicitly recover the original text, but it is unclear when they rely on context and when they implicitly do so.
Approach: They propose to use a dictionary to recover adversarial words by using a phonetic, typo, and visual attack to study word recovery performance.
Outcome: The proposed model outperforms open-source models on hateful, offensive, and toxic classification tasks.
LLM-Generated Text May Harm Your Retrieval! A Robust Detection Strategy for Retrieval-Augmented Generation (2026.acl-long)

Copied to clipboard

Challenge: Retrieval-augmented generation (RAG) improves accuracy and timeliness of large language models, but external corpora may become contaminated with LLM-generated texts.
Approach: They propose a method that integrates external knowledge retrieved from external sources into RAG to filter out LLM-generated texts from retrieved results.
Outcome: The proposed method mitigates performance degradation and improves stability of RAG systems.
Vulnerabilities of Large Language Models to Adversarial Attacks (2024.acl-tutorials)

Copied to clipboard

Challenge: This tutorial focuses on the vulnerabilities of Large Language Models to adversarial attacks . the tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity .
Approach: This tutorial lays the foundation by explaining safety-aligned LLMs and concepts in cybersecurity.
Outcome: The tutorial lays the foundation by explaining safety-aligned models and concepts in cybersecurity.
Real, Fake, or Manipulated? Detecting Machine-Influenced Text (2025.findings-emnlp)

Copied to clipboard

Challenge: Prior work on machine generated text detection focused on identifying whether document was human or machine written, ignoring these fine-grained uses.
Approach: They propose a machine-influenced text detector that learns to separate text samples from four primary types . the detector uses a subcategory guidance module to help separate the fine-grained categories .
Outcome: The proposed detector outperforms the state-of-the-art in five LLMs and six domains.
What Does the Bot Say? Opportunities and Risks of Large Language Models in Social Media Bot Detection (2024.acl-long)

Copied to clipboard

Challenge: Social media bot detection has always been an arms race between advancements in machine learning and adversarial bot strategies to evade detection.
Approach: They propose a mixture-of-heterogeneous-experts framework to divide and conquer diverse user information modalities and propose LLM-guided manipulation of user textual and structured information to evade detection.
Outcome: The proposed framework outperforms state-of-the-art baselines on 1,000 annotated examples while bringing down existing detectors by 29.6% and harming calibration and reliability of bot detection systems.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations