Trustworthiness and Self-awareness in Large Language Models: An Exploration through the Think-Solve-Verify Framework (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are becoming increasingly influential in reasoning tasks, but they lack trustworthiness and introspective self-awareness when subjected to complex reasoning tasks. |
| Approach: | They propose a framework to explore LLMs’ trustworthiness, introspective self-awareness, and collaborative reasoning by using the Think-Solve-Verify framework. |
| Outcome: | The proposed approach improves from 67.3% to 72.8% on the AQuA dataset and demonstrates the model’s ability to explain the given answers. |
Similar Papers
Large Language Models are Better Reasoners with Self-Verification (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to solve complex natural language processing tasks require multiple steps to verify the answers. |
| Approach: | They propose to use chain of thought prompting to solve reasoning tasks with large language models. |
| Outcome: | The proposed method can improve reasoning performance on arithmetic, commonsense, and logical reasoning datasets. |
Think Twice Before Trusting: Self-Detection for Large Language Models through Comprehensive Answer Reflection (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches to self-detection only retrospectively evaluate LLM-generated answers, leading to over-trust in incorrectly generated answers. |
| Approach: | They propose a self-detection paradigm that considers the comprehensive answer space beyond LLM-generated answers to mitigate the over-trust in LLM generated incorrect answers. |
| Outcome: | The proposed framework can be integrated with existing approaches for superior self-detection. |
Confidence Improves Self-Consistency in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Modern large language models (LLMs) demonstrate strong reasoning capabilities, driven in part by their capacity to generate a sequence of intermediate reasoning steps that lead them toward a final answer. |
| Approach: | They propose a method that performs a weighted majority vote based on confidence scores obtained directly from the model. |
| Outcome: | The proposed method outperforms self-consistency on nine models and four datasets, reducing the required number of reasoning paths by over 40% on average. |
Establishing Trustworthiness: Rethinking Tasks and Model Evaluation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Language understanding is a multi-faceted cognitive capability, which the Natural Language Processing community has striven to model computationally for decades. |
| Approach: | They propose to rethink what constitutes tasks and model evaluation in NLP and pursue a more holistic view on language, placing trustworthiness at the center. |
| Outcome: | The proposed models are based on generative models and are being deployed in more real-world scenarios, including previously unforeseen zero-shot setups. |
Self-Para-Consistency: Improving Reasoning Tasks at Low Cost for Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Recent studies have shown that self-consistency decoding can improve performance for complex reasoning tasks with large language models. |
| Approach: | They propose a self-consistency decoding strategy that generates multiple paraphrases for each test question and then generates reasoning paths for the original and all the paraphrased questions based on greedy decoding. |
| Outcome: | The proposed strategy reduces the sampling number and improves performance on complex reasoning tasks. |
Self-Training Large Language Models with Confident Reasoning (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models generate reasoning paths before final answers, but learning such a path requires costly human supervision. |
| Approach: | They propose a method that fine-tunes LLMs to prefer reasoning paths with high confidence . they propose 'cORE-PO' that fine tunes Lms to choose high-quality reasoning paths . |
| Outcome: | The proposed method improves the accuracy of outputs on four in-distribution and two out-of-difference benchmarks. |
Current Advances in LLM Reasoning (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial examines comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) advanced inference time methods and post-training methods that aim to make LLMs think more like humans are discussed in this tutorial. |
| Approach: | This tutorial explores comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) and discusses two types of methods to improve models’ reasoning: advanced inference time methods, structured and self-improvement inference methods, and post-training methods, such as RLHF, DPO, and GRPO. |
| Outcome: | This tutorial examines evaluation strategies to assess the reasoning abilities of large language models and discusses two types of methods to improve models’ reasoning. |
Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM Sampling (2025.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate reasoning paths before answers, but lack a systematic approach to determine optimal number of samples or select the most faithful rationale. |
| Approach: | They propose a framework that evaluates the quality of reasoning and consistency of answers for each generated sample and uses criteria-based stopping and weighted majority voting to guide early stopping decisions and rationale selection. |
| Outcome: | The proposed framework outperforms existing methods while maintaining accuracy. |
Thinking Twice Makes Large Language Models Safer and More Helpful (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing safety alignment techniques for large language models (LLMs) struggle to balance harmlessness and usefulness. |
| Approach: | They propose a safety-aware reflection-based reasoning framework that internalizes self-reflective reasoning and encourages reflection and correction. |
| Outcome: | The proposed framework outperforms reasoning-based alignment methods in safety alignment. |
A Closer Look at the Self-Verification Abilities of Large Language Models in Logical Reasoning (2024.naacl-long)
Copied to clipboard
| Challenge: | Existing models of large language models struggle with complex logical reasoning problems. |
| Approach: | They propose to use large language models to identify their own errors to improve their models' performance. |
| Outcome: | The proposed models can identify logical fallacies accurately and improve by themselves. |