Papers with Self-consistency
Self-Consistency Falls Short! The Adverse Effects of Positional Bias on Long-Context Problems (2026.tacl-1)
Copied to clipboard
| Challenge: | Existing approaches to improve long-context understanding of large language models lack scalability and stability. |
| Approach: | They challenge the assumption that SC’s benefits generalize to long-context settings . they find that persistent position bias degrades performance on long-consistency tasks . |
| Outcome: | The proposed approach fails to improve and actively degrades performance on long-context tasks. |
Boosting Self-Consistency with Ranking (2026.acl-srw)
Copied to clipboard
Maria Marina, Daniil Moskovskiy, Sergey Pletenev, Mikhail Salnikov, Alexander Panchenko, Viktor Moskvoretskii
| Challenge: | Existing approaches to improve performance of large language models include self-consistency, RISC, extended reasoning, and iterative self-correction. |
| Approach: | They propose a test-time scaling technique that uses multiple features to score candidate answers in self-consistency as a ranking problem. |
| Outcome: | The proposed method achieves better accuracy-efficiency trade-off than standard self-consistency and strong baselines on three datasets. |
Dynamic Voting for Efficient Reasoning in Large Language Models (2023.findings-emnlp)
Copied to clipboard
Mingfeng Xue, Dayiheng Liu, Wenqiang Lei, Xingzhang Ren, Baosong Yang, Jun Xie, Yidan Zhang, Dezhong Peng, Jiancheng Lv
| Challenge: | Multi-path voting methods generate multiple reasoning paths for each problem, causing factual errors and illusion generation. |
| Approach: | They propose a multi-path voting technique that effectively reduces the number of reasoning paths during multi-path voting while preserving accuracies. |
| Outcome: | The proposed method outperforms Self-consistency using 24.7% of the number of paths on the LetterConcat task. |
Make Every Penny Count: Difficulty-Adaptive Self-Consistency for Cost-Efficient Reasoning (2025.findings-naacl)
Copied to clipboard
Xinglin Wang, Shaoxiong Feng, Yiwei Li, Peiwen Yuan, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing decoding strategies for chain-of-thought reasoning do not exploit prior information about question difficulty. |
| Approach: | They propose a decoding strategy called self-consistency to improve reasoning performance by adjusting the number of samples based on the posterior distribution of a set of pre-samples. |
| Outcome: | The proposed method outperforms baseline methods on arithmetic, commonsense and symbolic reasoning tasks while achieving comparable performance. |
CERET: Cost-Effective Extrinsic Refinement for Text Generation (2024.naacl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) generate incomplete, biased or misleading outputs in their initial attempts. |
| Approach: | They propose a method for refining text generation that takes into account semantic stability, entailment and inter-sample uncertainty measures. |
| Outcome: | The proposed method outperforms self-consistency and self-rerank baselines under various task setups by 1.6% and 3.5% respectively. |
Integrate the Essence and Eliminate the Dross: Fine-Grained Self-Consistency for Free-Form Language Generation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing methods to improve output quality without aggregating input tokens are limited by the complexity of aggregation of responses. |
| Approach: | They propose to extract and integrate segment-level commonalities from candidate samples to enhance performance of LLMs in open-ended and reasoning tasks. |
| Outcome: | The proposed method improves performance on reasoning, code generation and mathematical reasoning tasks without requiring additional models and overlooking the knowledge present among the candidates. |
Revisiting Self-Consistency from Dynamic Distributional Alignment Perspective on Answer Aggregation (2025.findings-acl)
Copied to clipboard
Yiwei Li, Ji Zhang, Shaoxiong Feng, Peiwen Yuan, Xinglin Wang, Jiayi Shi, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li
| Challenge: | Existing studies on self-consistency show that it improves reasoning abilities by aggregating diverse stochastic samples. |
| Approach: | They propose a confidence-driven mechanism that dynamically calibrates temperature to align with high probability modes. |
| Outcome: | The proposed method outperforms fixed-diversity baselines on reasoning tasks and improves both average and best-case performance. |
Self-Consistency from Only Two Samples: CoT–PoT Ensembling for Efficient LLM Reasoning (2026.findings-acl)
Copied to clipboard
| Challenge: | Self-consistency (SC) is a popular technique for improving the reasoning accuracy of large language models but it comes at a high computational cost due to extensive sampling. |
| Approach: | They propose a hybrid ensembling approach that leverages the complementary strengths of Chain-of-Thought and Program-of -Thus . they propose encapsulating two different modes of reasoning to create a single output and a final answer is selected as the most frequently occurring one among these outputs. |
| Outcome: | The proposed approach reduces the number of samples required for SC by 9.3x . the majority of tasks can be addressed with only two samples, which has not been possible with prior methods. |