Challenge: Existing training-free alternatives to training-based models are static or depend on external guidance.
Approach: They propose a training-free adaptation framework that enables a frozen LLM to improve online by distilling supervision from its own inference experiences.
Outcome: The proposed framework outperforms existing test-time adaptation methods under online evaluation.

Similar Papers

Contrastive Learning for Task-Independent SpeechLLM-Pretraining (2025.findings-acl)

Copied to clipboard

Challenge: Large language models excel in speech processing tasks but their reliance on written text limits their application in real-world scenarios.
Approach: They propose a task-independent speech pretraining stage and task-specific fine-tuning stage to adapt LLMs to speech processing tasks.
Outcome: The proposed model outperforms models specialized on speech translation and question answering while being trained on 10% of the task-specific data.
CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods to improve the reasoning performance of Large Language Models (LLMs) ignore annotated Chain-of-Thought (CoT) and incorporate unstable reasoning path sampling.
Approach: They propose a Contrastive learning with annotated CoT-based Reinforced Fine-Tuning approach to enhance the reasoning performance of Large Language Models.
Outcome: The proposed approach exploits annotated CoT and stabilizes the fine-tuning procedure by incorporating an additional unsupervised learning signal.
Step-level Verifier-guided Hybrid Test-Time Scaling for Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Recent training-based TTS methods, such as continued reinforcement learning, have surged in popularity, while training-free TTS approaches are gradually fading from prominence.
Approach: They propose a fine-grained sequential scaling method guided by process verification that integrates training-free TTS methods with other classical parallel scaling methods at the step level.
Outcome: Experiments on five instruction-tuned large language models (LLMs) show that training-free TTS methods can extend reasoning performance boundaries.
TTVS: Boosting Self-Exploring Reinforcement Learning via Test-time Variational Synthesis (2026.findings-acl)

Copied to clipboard

Challenge: Existing test-time methods are limited in specialized or novel domains where supervision is prohibitively expensive or unavailable.
Approach: They propose a framework that augments training stream from unlabeled test queries.
Outcome: Extensive experiments show TTVS outperforms state-of-the-art RL-based techniques on unlabeled test-time data.
Less is More: Improving LLM Reasoning with Minimal Test-Time Intervention (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models (LLMs) have focused on test-time scaling to improve reasoning quality but at the cost of efficiency.
Approach: They propose a training-free framework that enhances reasoning accuracy and stability with minimal overhead.
Outcome: The proposed framework yields consistent gains across general, coding, and STEM tasks while remaining highly efficient.
Toward Structured Knowledge Reasoning: Contrastive Retrieval-Augmented Generation on Experience (2025.findings-acl)

Copied to clipboard

Challenge: Large language models struggle to infer implicit relationships embedded in tabular formats . authors introduce a framework that builds experience memory representations and enhances generalization through contrastive In-Context Learning (ICL).
Approach: They propose a framework that builds experience memory representations and enhances generalization through contrastive In-Context Learning to simulate human-like knowledge transfer.
Outcome: Experiments on Text-to-SQL and TableQA show CoRE significantly improves performance . it achieves gains of 3.44% and 4.24%, with up to 17.2% on challenging tasks .
ALW: Adaptive Layer-Wise contrastive decoding enhancing reasoning ability in Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Existing research has demonstrated that contrast decoding of two different models can improve text quality in open-ended text generation but with limited gains on reasoning tasks.
Approach: They propose a framework that dynamically disentangles noise in shallow layers from critical signals in deep layers to enhance reasoning ability.
Outcome: The proposed framework improves answer accuracy while maintaining inference efficiency.
Temporal Contrastive Decoding: A Training-Free Method for Large Audio-Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large audio-language models (LALMs) can exhibit a temporal smoothing bias . unified decoders can produce less specific audio-grounded outputs .
Approach: They propose a temporally blurred slow-path view that is re-encoded by a token-level logit update.
Outcome: Experiments on MMAU and AIR-Bench show consistent improvements on strong unified LALMs.
TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning (2022.findings-naacl)

Copied to clipboard

Challenge: Existing pre-trained MLMs produce an anisotropic distribution of token representations . this is not ideal for tasks that require discriminative semantic meanings of distinct tokens - a problem that exists in pre-training models .
Approach: They propose a continual pre-training approach that encourages BERT to learn an isotropic distribution of token representations.
Outcome: The proposed approach improves on a wide range of English and Chinese benchmarks.
Training LLMs for Divide-and-Conquer Reasoning Elevates Test-Time Scalability (2026.acl-long)

Copied to clipboard

Challenge: Large language models have demonstrated strong reasoning capabilities through step-by-step chain-of-thought (CoT) reasoning, but their strictly sequential nature constrains test-time scalability.
Approach: They propose an end-to-end reinforcement learning framework to enhance LLMs' DAC-style reasoning capacity by decomposing a problem into subproblems and solving them sequentially.
Outcome: The proposed model surpasses CoT by 8.6% and 6.3% on competition-level benchmarks and is available at the [github.com/MasterVito/DAC-RL].

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations