Challenge: Large language models (LLMs) have extensive world knowledge, but often generate inaccurate geospatial knowledge.
Approach: They propose a framework for evaluation of large language models to mitigate hallucinations . they use Kahneman-Tversky Optimization to align LLMs with their reality .
Outcome: The proposed evaluation framework uncovers hallucinations in 20 advanced LLMs.

Similar Papers

Knowledge Verification to Nip Hallucination in the Bud (2024.emnlp-main)

Copied to clipboard

Challenge: Recent studies have shown that large language models generate responses that sound plausible but contradict factual knowledge, a phenomenon known as hallucination.
Approach: They propose a novel approach to align large language models to evaluate knowledge boundaries based on external knowledge to reduce hallucinations .
Outcome: The proposed approach reduces hallucinations across six benchmarks using foundation LLMs of varying backbones and scales.
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)

Copied to clipboard

Challenge: Large language models are successful in answering factoid questions but are also prone to hallucination.
Approach: They propose self-reporting to the model when faced with such limitations.
Outcome: The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge.
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: a growing number of researchers are studying the hallucination issue in large language models.
Approach: They propose a hallucination detection benchmark and a method to detect hallucines in LLMs.
Outcome: The proposed method detects hallucinations and mitigates them using different training stages.
KGHaluBench: A Knowledge Graph-Based Hallucination Benchmark for Evaluating the Breadth and Depth of LLM Knowledge (2026.findings-eacl)

Copied to clipboard

Challenge: Existing benchmarks for large language models are limited by static and narrow questions, leading to limited coverage and misleading evaluations.
Approach: They propose a Knowledge Graph-based hallucination benchmark that assesses Large Language Models across the breadth and depth of their knowledge and provides a fairer and more comprehensive insight into LLM truthfulness.
Outcome: The proposed framework assesses LLMs across breadth and depth of their knowledge, and provides a fairer and more comprehensive insight into LLM truthfulness.
Language Models Hallucinate, but May Excel at Fact Verification (2024.naacl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have produced non-factual outputs . however, current LLMs suffer from the hallucination issue .
Approach: They propose to use instruction-tuned LLMs to generate factual outputs . they find that FLAN-T5-11B performs best as a fact verifier .
Outcome: The proposed method outperforms more capable LLMs like GPT3.5 and ChatGPT in the human evaluation.
INFACT: A Diagnostic Benchmark for Induced Faithfulness and Factuality Hallucinations in Video-LLMs (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks only evaluate models in clean settings due to hallucinations .
Approach: They propose a diagnostic benchmark that evaluates models in four modes for faithfulness and factuality.
Outcome: The proposed benchmark evaluates models in four modes: Base (clean), Visual Degradation, Evidence Corruption, and Temporal Intervention for order-sensitive items.
Mitigating Hallucination by Integrating Knowledge Graphs into LLM Inference – a Systematic Literature Review (2025.acl-srw)

Copied to clipboard

Challenge: Large Language Models (LLMs) have made significant progress on different language tasks, but they tend to "hallucinate" plausible but factually incorrect answers.
Approach: They propose to integrate knowledge graphs (KGs) into LLM inference to reduce hallucinations by searching online and applying a selection process.
Outcome: The proposed integration improves performance on benchmark datasets and also to mitigate hallucinations.
The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive Remediations (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in Large Language Models have generated widespread acclaim, but hallucination has also emerged as a by-product.
Approach: They propose a fine-grained discourse on profiling hallucination based on its degree, orientation, and category . they categorize hallucines into six types: acronym ambiguity, generated golem, virtual voice, geographic erratum, time wrap .
Outcome: The proposed method categorizes hallucination into six types based on their degree, orientation, and category .
KG-FPQ: Evaluating Factuality Hallucination in LLMs with Knowledge Graph-based False Premise Questions (2025.coling-main)

Copied to clipboard

Challenge: Existing benchmarks that assess this vulnerability rely on manual construction, resulting in limited size and lack of expandability.
Approach: They propose a method to generate false premise questions based on knowledge graphs . they modify true triplets extracted from KGs to create false premises .
Outcome: The proposed method generates semantically rich FPQs using state-of-the-art GPTs.
UrbanGeoEval: A City-Scale Benchmark for Evaluating Large Language Models in Geospatial Reasoning (2026.acl-long)

Copied to clipboard

Challenge: Extensive experiments on 18 widely used LLMs uncover critical insights: (1) models exhibit severe geographic biases and resolution gaps; (2) failures in complex multi-hop tasks stem from brittle foundational spatial skills rather than high-level logic deficits.
Approach: They propose a dual-module framework that disentangles factual recall and spatial logic from the model's real capabilities in urban environments.
Outcome: Extensive tests on 18 widely used LLMs reveal that models exhibit severe geographic biases and resolution gaps, and failures in complex multi-hop tasks often stem from brittle foundational spatial skills rather than high-level logic deficits.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations