Challenge: Large Language Models (LLMs) generate misleading answers because of hallucinations . despite their capabilities, LLMs suffer from hallucinisms, which leads to unfaithful answers .
Approach: They propose a method to identify and answer questions with false assumptions . they first investigate whether the problem reduces to fact verification . then, they leverage external evidence to mitigate hallucinations .
Outcome: The proposed approach reduces the problem to fact verification and provides interpretable answers by pinpointing the false assumptions.

Similar Papers

(QA)2: Question Answering with Questionable Assumptions (2023.acl-long)

Copied to clipboard

Challenge: a number of questions contain questionable assumptions, such as when did Marie Curie discover Uranium, that cannot be answered as a true when question.
Approach: They propose an open-domain evaluation dataset that can detect questionable assumptions . they propose a method that can be used to produce adequate responses for questions with questionable assumption.
Outcome: The proposed model detects questionable assumptions and produces adequate responses for both types of questions.
The Curious Case of Hallucinatory (Un)answerability: Finding Truths in the Hidden States of Over-Confident Large Language Models (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) have been shown to possess impressive capabilities, but they are not problem-free.
Approach: They explore the behavior of large language models when presented with (un)answerable queries.
Outcome: The proposed models encode the answerability of an input query, the authors show . they also show that the first decoded token is a strong indicator .
Evaluating Reasoning Models for Queries with Presuppositions (2026.findings-acl)

Copied to clipboard

Challenge: Prior work notes that large language models fail to challenge erroneous assumptions and can reinforce users’ misinformed opinions.
Approach: They construct queries with varying degrees of presuppositions spanning health, science, and general knowledge and evaluate several widely-deployed models.
Outcome: The proposed models achieve higher accuracy but fail to challenge a large fraction of false presuppositions.
Can NLI Models Verify QA Systems’ Predictions? (2021.findings-emnlp)

Copied to clipboard

Challenge: Recent question answering systems perform well on benchmark datasets, but are not always well-calibrated to spot spurious answers under distribution shifts.
Approach: They propose to use natural language inference to verify whether answers are correct . they leverage large pre-trained models and recent prior datasets to construct powerful question conversion and decontextualization modules.
Outcome: The proposed approach improves the confidence estimation of a QA model across different domains, evaluated in a selective QA setting.
From Misleading Queries to Accurate Answers: A Three-Stage Fine-Tuning Method for LLMs (2025.findings-acl)

Copied to clipboard

Challenge: Existing methods focus on correcting the output but overlook the ability of LLMs to detect and correct misleading content in the input itself.
Approach: They propose a three-stage fine-tuning method that improves LLMs' ability to detect and correct misleading information in input queries.
Outcome: The proposed method improves accuracy and factuality of LLM responses while also reducing hallucinations.
Knowing What LLMs DO NOT Know: A Simple Yet Effective Self-Detection Method (2024.naacl-long)

Copied to clipboard

Challenge: Recent literature reveals that Large Language Models (LLMs) hallucinate intermittently, which impedes their reliability for further utilization.
Approach: They propose a self-detection method to detect which questions an LLM does not know by combining the two components to identify whether the model generates a non-factual response to the question.
Outcome: The proposed method can detect which questions an LLM does not know across factoid question-answering, arithmetic reasoning, and commonsense reasoning tasks.
Don’t Just Say “I don’t know”! Self-aligning Large Language Models for Responding to Unknown Questions with Explanations (2024.emnlp-main)

Copied to clipboard

Challenge: Existing studies investigate ways to refuse to answer unknown questions . Large Language Models (LLMs) display a significant level of overconfidence when answering questions that they are aware of.
Approach: They propose a self-alignment method to utilize Large Language Models to enhance its response-ability to unknown questions.
Outcome: The proposed method is superior to baseline methods on four types of unknown questions.
Factuality of Large Language Models: A Survey (2024.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are factually incorrect, which limits their applicability in real-world scenarios.
Approach: They analyze existing work to identify major challenges and their associated causes . they propose to evaluate LLMs using a variety of measures to mitigate factual errors .
Outcome: The proposed methods are based on a variety of datasets and proposed strategies to mitigate factual errors.
On Large Language Models’ Hallucination with Regard to Known Facts (2024.naacl-long)

Copied to clipboard

Challenge: Large language models are successful in answering factoid questions but are also prone to hallucination.
Approach: They propose self-reporting to the model when faced with such limitations.
Outcome: The proposed classifier can detect hallucinations with an 88% success rate and can be used to answer factoid questions with correct answer knowledge.
SHAP-Based Explanation Methods: A Review for NLP Interpretability (2022.coling-1)

Copied to clipboard

Challenge: Existing models with opacity problems have been proposed to address this problem.
Approach: They propose a unified local-interpretability framework with a rigorous theoretical foundation on the game-theoretic concept of Shapley values.
Outcome: The proposed framework is based on the Shapley-value-based model explanations.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations