CoT-UQ: Improving Response-wise Uncertainty Quantification in LLMs with Chain-of-Thought (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing uncertainty quantification methods for Large language models are primarily prompt-wise rather than response-wise, which leads to inefficiency. |
| Approach: | They propose a new approach to quantify response-wise uncertainty by integrating LLMs’ inherent reasoning capabilities through Chain-of-Thought (CoT) into the UQ process. |
| Outcome: | The proposed framework outperforms existing uncertainty quantification methods and achieves an average improvement of 5.9% AUROC compared to existing methods. |
Similar Papers
LUQ: Long-text Uncertainty Quantification for LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing research on Uncertainty Quantification (UQ) predominantly targets short text generation, however, real-world applications often necessitate much longer responses. |
| Approach: | They propose a method that ensembles responses from multiple models and selects the response with the lowest uncertainty. |
| Outcome: | The proposed method outperforms baseline methods in correlating with the model’s factuality scores (negative coefficient of -0.85 observed for Gemini Pro). |
Uncertainty Quantification for Large Language Models (2025.acl-tutorials)
Copied to clipboard
| Challenge: | Large language models (LLMs) produce hallucinations, which undermine user trust and reliability. |
| Approach: | This tutorial offers the first systematic introduction to uncertainty quantification (UQ) for LLMs in text generation tasks. |
| Outcome: | The proposed framework provides tools for communicating the reliability of a model answer. |
Shifting Attention to Relevance: Towards the Predictive Uncertainty Quantification of Free-Form Large Language Models (2024.acl-long)
Copied to clipboard
Jinhao Duan, Hao Cheng, Shiqi Wang, Alex Zavalny, Chenan Wang, Renjing Xu, Bhavya Kailkhura, Kaidi Xu
| Challenge: | Large Language Models (LLMs) show promising results in language generation but often “hallucinate”, making their outputs less reliable. |
| Approach: | They propose to shift attention to more relevant components at token- and sentence-levels for better UQ. |
| Outcome: | The proposed approach improves the performance of a range of popular “off-the-shelf” LLMs with model sizes extending up to 33B parameters. |
IUQ: Interrogative Uncertainty Quantification for Long-Form Large Language Model Generation (2026.acl-long)
Copied to clipboard
| Challenge: | Recent approaches to quantify uncertainty in LLMs produce short or constrained answer sets, but many real-world applications require long-form and free-form text generation. |
| Approach: | They propose a framework that leverages inter-sample consistency and intra-sampled faithfulness to quantify the uncertainty in long-form LLM outputs. |
| Outcome: | The proposed framework provides reliable measures of claim-level uncertainty and the model’s faithfulness over two widely used long-form generation datasets. |
Uncertainty Quantification in LLM Agents: Foundations, Emerging Challenges, and Opportunities (2026.acl-long)
Copied to clipboard
Changdae Oh, Seongheon Park, To Eun Kim, Jiatong Li, Wendi Li, Samuel Yeh, Sean Du, Hamed Hassani, Paul Bogdan, Dawn Song, Sharon Li
| Challenge: | Uncertainty quantification (UQ) for large language models is a key building block for daily applications. |
| Approach: | They propose a general formulation of agent UQ that subsumes broad classes of existing UQ setups. |
| Outcome: | The proposed framework is based on the first general formulation of agent UQ that subsumes broad classes of existing setups. |
SIMBA UQ: Similarity-Based Aggregation for Uncertainty Quantification in Large Language Models (2025.findings-emnlp)
Copied to clipboard
Debarun Bhattacharjya, Balaji Ganesan, Junkyu Lee, Radu Marinescu, Katya Mirylenka, Michael Glass, Xiao Shou
| Challenge: | Uncertainty quantification (UQ) provides measures of uncertainty, such as an estimate of the confidence in an LLM’s generated output. |
| Approach: | They propose a black-box approach where consistency is used as a proxy for confidence in a model's output. |
| Outcome: | The proposed methods are primarily but not necessarily entirely black- box, with consistency between output and other sampled generations used as a proxy for confidence in its correctness. |
Token-Level Density-Based Uncertainty Quantification Methods for Eliciting Truthfulness of Large Language Models (2025.naacl-long)
Copied to clipboard
Artem Vazhentsev, Lyudmila Rvanova, Ivan Lazichny, Alexander Panchenko, Maxim Panov, Timothy Baldwin, Artem Shelmanov
| Challenge: | Uncertainty quantification (UQ) is a prominent approach for eliciting truthful answers from large language models (LLMs). |
| Approach: | They propose to use a well-established method for text generation to extract token embeddings from multiple layers of LLMs and compute MD scores for each token. |
| Outcome: | The proposed method improves on existing methods and provides accurate and computationally efficient uncertainty scores for sequence-level selective generation and claim-level fact-checking tasks. |
MAQA: Evaluating Uncertainty Quantification in LLMs Regarding Data Uncertainty (2025.findings-naacl)
Copied to clipboard
| Challenge: | despite advances in large language models, they still produce false but incorrect responses. |
| Approach: | They propose a new benchmark for large language models that requires more than two unambiguous answers . they also assess 5 different uncertainty quantification methods in the presence of data uncertainty. |
| Outcome: | The proposed method fails in multi-answer question answering tasks compared to single-answered questions . entropy- and consistency-based methods effectively estimate model uncertainty, the authors show . |
Uncertainty Quantification of Large Language Models through Multiple Uncertainty Sources (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing methods for uncertainty quantification fail to capture multifaceted nature of natural language generation. |
| Approach: | They propose a multi-resource Uncertainty Quantification framework that integrates heterogeneous uncertainty signals into a unified measure. |
| Outcome: | The proposed framework outperforms existing methods on CoQA, NQ_Open, and HotpotQA. |
Evaluating Uncertainty Quantification Methods in Argumentative Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | ArgLLMs are an explainable LLM framework for decision-making based on computational argumentation in which uncertainty quantification plays a critical role. |
| Approach: | They propose to integrate LLM UQ methods into argumentative LLMs to evaluate their performance on claim verification tasks. |
| Outcome: | The proposed method outperforms more complex approaches on claim verification tasks. |