Papers with REVEAL
A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning Chains (2024.acl-long)
Copied to clipboard
Alon Jacovi, Yonatan Bitton, Bernd Bohnet, Jonathan Herzig, Or Honovich, Michael Tseng, Michael Collins, Roee Aharoni, Mor Geva
| Challenge: | Recent literature discusses automatic methods to evaluate reasoning to improve their correctness, but no fine-grained step-level datasets are available to enable thorough evaluation of such verification methods. |
| Approach: | They propose to benchmark automatic verifiers of complex Chain-of-Thought reasoning in open-domain question-answering settings using a dataset that includes comprehensive labels for relevance, attribution to evidence passages, and logical correctness of each reasoning step. |
| Outcome: | The proposed dataset shows that verifiers struggle at verifying reasoning chains, particularly verifying logical correctness and detecting contradictions. |
Reasoning-Aware AIGC Detection via Alignment and Reinforcement (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to AIGC detection have relied on statistical classifiers or black-box neural models, which exploit surface-level patterns and struggle to generalize as LLMs evolve. |
| Approach: | They propose a framework that generates interpretable reasoning chains before classification using supervised fine-tuning and reinforcement learning to improve accuracy. |
| Outcome: | The proposed framework achieves state-of-the-art performance across multiple benchmarks, offering a robust and transparent solution for AIGC detection. |