Papers with GPQA-Diamond
Dynamic Cheatsheet: Test-Time Learning with Adaptive Memory (2026.eacl-long)
Copied to clipboard
| Challenge: | Unlike fine-tuning or static retrieval methods, DC adapts LMs’ problem-solving skills on the fly, without modifying their underlying parameters. |
| Approach: | They propose a lightweight framework that endows a black-box LM with a persistent, evolving memory. |
| Outcome: | The proposed framework enables models to store and reuse accumulated strategies, code snippets, and general problem-solving insights at inference time. |
Prompting Test-Time Scaling Is A Strong LLM Reasoning Data Augmentation (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models exhibit strong reasoning when guided by chain-of-thought exemplars . collecting large, high-quality reasoning datasets remains laborious and resource-intensive . |
| Approach: | They propose a prompt-space data augmentation framework for enhancing LLM reasoning . they use a pool of 90 randomly selected reasoning instances to elicit diverse reasoning trajectories . |
| Outcome: | The proposed framework improves accuracy over small-data benchmarks and generalization on out-of-domain reasoning evaluations. |
Accelerated Test-Time Scaling with Model-Free Speculative Sampling (2025.emnlp-main)
Copied to clipboard
Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati
| Challenge: | Language models have demonstrated remarkable capabilities in reasoning tasks through test-time scaling techniques like best-of-N sampling and tree search. |
| Approach: | They propose a model-free speculative decoding approach that exploits redundancy in reasoning trajectories to achieve significant acceleration without compromising accuracy. |
| Outcome: | The proposed approach reduces inference latency by 60-65% while maintaining accuracy. |
Prior Prompt Engineering for Reinforcement Fine-Tuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have focused on algorithms, reward shaping, and data curation, but prior prompt engineering is understudied. |
| Approach: | They investigate prior prompt engineering (pPE) in reinforcement fine-tuning . they translate five representative iPE strategies into corresponding pPE approaches . |
| Outcome: | The proposed approaches outperform iPE-prompted models on in-domain and out-of-domain benchmarks. |
ThinkTuning: Instilling Cognitive Reflections without Distillation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. |
| Approach: | They propose a GRPO-based interactive training approach that augments the rollouts of a student model with the guidance of . a teacher poses a problem, lets the student try an answer, then gives corrective feedback–enough to point the mind in the right direction and then show the correct solution. |
| Outcome: | The proposed method shows 3.69% improvement over zero-shot baselines and 2.08% and 3.99% improvement over the vanilla-GRPO baselines. |
Thinking Traps in Long Chain-of-Thought: A Measurable Study and Trap-Aware Adaptive Restart (2026.findings-acl)
Copied to clipboard
null Chenkang, Fan Yu, Junjie Nian, Sihan Zhao, Zhuoka Feng, Zijun Yao, Wang Heng, Yu Minshen, Yixin Cao
| Challenge: | Experiments show that extended generation does not guarantee correctness . a recurring pattern in Long-CoT failures is a problem for large reasoning models . |
| Approach: | They propose a test-time control framework that truncates the trajectory before the trap segment and adaptively restarts decoding. |
| Outcome: | Experiments show that TAAR improves reasoning performance without fine-tuning model parameters. |