Papers by James Petullo
VecCISC: Improving Confidence-Informed Self-Consistency with Reasoning Trace Clustering and Candidate Answer Selection (2026.findings-acl)
Copied to clipboard
| Challenge: | Weighted majority voting requires a critic to evaluate each candidate’s reasoning trace to produce the answer’s confidence score. |
| Approach: | They propose a lightweight framework that uses a measure of semantic similarity to filter reasoning traces that are semantically equivalent to others, degenerate, or hallucinated. |
| Outcome: | The proposed framework reduces token usage by 47% while maintaining or exceeding the accuracy of CISC. |