Non-Existent Relationship: Fact-Aware Multi-Level Machine-Generated Text Detection (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting LLMs lack the authenticity of the entity graph . lmgenerated text is misused, including fake news and spam . |
| Approach: | They propose a fact-aware model that assesses discrepancies between textual and factual entity graphs through graph comparison. |
| Outcome: | The proposed model outperforms state-of-the-art methods on three public datasets showing that it can capture differences in entity graphs between machine-generated and human-written texts. |
Similar Papers
Hallucination Detection in Long-Form Text Generated by LLMs: A Benchmark and a Hyper-Relational Knowledge Graph Approach (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for hallucination detection are coarse-grained and lack long-range consistency checks. |
| Approach: | They propose a benchmark for long-form hallucination detection that incorporates diverse entity types and intricate factual dependencies spanning extended contexts. |
| Outcome: | The proposed framework outperforms baselines and robustly integrates fact-centric hyper-relational knowledge graphs. |
FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data (2025.naacl-long)
Copied to clipboard
| Challenge: | Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. |
| Approach: | They propose a method that leverages multi-hop reasoning on context graphs extracted from documents to generate complex multi-level claims without relying on LLMs to decide data labels. |
| Outcome: | The proposed model outperforms GPT-4-o on the LLM-Aggrefact benchmark with much smaller model size. |
Neural Deepfake Detection with Factual Structure of Text (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to deepfake detection typically represent documents with coarse-grained representations, but they struggle to capture factual structures of documents. |
| Approach: | They propose a graph-based model that captures factual structures of documents for deepfake detection. |
| Outcome: | The proposed model improves strong base models built with RoBERTa on two public deepfake datasets. |
IDEATE: Detecting AI-Generated Text Using Internal and External Factual Structures (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing methods to detect AI-generated text rely on internal evidences, but external evidences are not considered. |
| Approach: | They propose a hierarchical graph network that utilizes internal and external factual structures to detect AI-generated text. |
| Outcome: | The proposed network outperforms current state-of-the-art methods on four datasets. |
M4: Multi-generator, Multi-domain, and Multi-lingual Black-Box Machine-Generated Text Detection (2024.eacl-long)
Copied to clipboard
Yuxia Wang, Jonibek Mansurov, Petar Ivanov, Jinyan Su, Artem Shelmanov, Akim Tsvigun, Chenxi Whitehouse, Osama Mohammed Afzal, Tarek Mahmoud, Toru Sasaki, Thomas Arnold, Alham Aji, Nizar Habash, Iryna Gurevych, Preslav Nakov
| Challenge: | Large language models generate fluent responses to user queries, but they are also susceptible to misuse in journalism, education, and academia. |
| Approach: | They propose a large-scale benchmark for machine-generated text detection that is a multi-generator, multi-domain, and multi-lingual corpus. |
| Outcome: | The proposed system can detect machine-generated text and pinpoint misuse . the proposed system is based on a large-scale benchmark dataset . |
LLMs as Knowledge Graph Refiners: Mitigating Factual Inconsistencies in Generative Knowledge Extraction (2026.acl-long)
Copied to clipboard
| Challenge: | Knowledge graphs (KGs) represent real-world entities and their relations in a structured form. |
| Approach: | They propose a framework that performs triple-level refinement on KGs constructed via GKE. |
| Outcome: | The proposed framework improves KG quality from diverse perspectives. |
Real, Fake, or Manipulated? Detecting Machine-Influenced Text (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Prior work on machine generated text detection focused on identifying whether document was human or machine written, ignoring these fine-grained uses. |
| Approach: | They propose a machine-influenced text detector that learns to separate text samples from four primary types . the detector uses a subcategory guidance module to help separate the fine-grained categories . |
| Outcome: | The proposed detector outperforms the state-of-the-art in five LLMs and six domains. |
Are the Hidden States Hiding Something? Testing the Limits of Factuality-Encoding Capabilities in LLMs (2025.acl-long)
Copied to clipboard
| Challenge: | Recent studies suggest that LLMs encode internal representations of factuality when generating inaccurate or fabricated content. |
| Approach: | They propose a strategy for sampling plausible true-false factoid sentences from tabular data and a procedure for generating realistic, LLM-dependent true-False datasets from Question Answering collections. |
| Outcome: | The proposed approach lays the groundwork for future research on factuality in LLMs and offers practical guidelines for more effective evaluation. |
From Text to Source: Results in Detecting Large Language Model-Generated Content (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate human-like text, but have ethical and misuse concerns. |
| Approach: | They evaluate whether a classifier trained to distinguish between source and target LLMs can detect text from an LLM without further training. |
| Outcome: | The proposed method detects text from target LLMs without further training. |
Factuality of Large Language Models: A Survey (2024.emnlp-main)
Copied to clipboard
Yuxia Wang, Minghan Wang, Muhammad Arslan Manzoor, Fei Liu, Georgi Georgiev, Rocktim Das, Preslav Nakov
| Challenge: | Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios. |
| Approach: | They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors . |
| Outcome: | The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors. |