Challenge: Small Language Models (SLMs) are becoming increasingly popular in specialized fields such as industrial applications.
Approach: They propose a framework which transfers reasoning capabilities via Chain-of-Thought distillation from Large Language Models (LLMs) to smaller, more efficient models (SLMs)
Outcome: The proposed framework outperforms the base models in Industry 4.0 by a significant margin.

Similar Papers

Mixed Distillation Helps Smaller Language Models Reason Better (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent large language models (LLMs) have demonstrated impressive multiple step-by-step reasoning capabilities in recent NLP reasoning tasks.
Approach: They propose a mixed distillation framework that distills multiple step-by-step reasoning abilities into smaller language models (SLMs) they leverage LLMs to generate multiple step by step reasoning rationales by sampling automatically.
Outcome: The proposed framework outperforms existing models on SVAMP, GSM8K and ASDIV, while a single model generated by MD exceeds the comprehensive performance of two individual CoT and PoT distilled models.
Aligning Large and Small Language Models via Chain-of-Thought Reasoning (2024.eacl-long)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) prompting empowers Large Language Models to solve complex reasoning tasks in a step-wise manner.
Approach: They propose a method for aligning and transferring reasoning abilities between larger and smaller Language Models by using CoT-Demonstrations.
Outcome: The proposed method outperforms baselines on question-answering and mathematical reasoning benchmarks.
Unveiling the Key Factors for Distilling Chain-of-Thought Reasoning (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in reasoning tasks through Chain-of-Thought prompting.
Approach: They examine the factors influencing CoT distillation including granularity, format and teacher model.
Outcome: The proposed model is based on four teacher models and seven student models across seven mathematical and commonsense reasoning datasets.
PaD: Program-aided Distillation Can Teach Small Models Reasoning Better than Chain-of-thought Fine-tuning (2024.naacl-long)

Copied to clipboard

Challenge: Large language models excel in various tasks, but their huge size and inaccessibility of parameters present challenges for practical deployment.
Approach: They propose to use CoT data to distill task-specific ability from large language models to smaller models . they use reasoning programs to suppress errors in distilled data and improve distillation quality .
Outcome: The proposed model outperforms LLMs on arithmetic reasoning, symbolic reasoning, and general ability.
SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to continuous-space reasoning focus on hard token decoding and suffer from catastrophic forgetting.
Approach: They propose a method that generates instance-specific soft thought tokens as the initial chain of thoughts and maps them into the LLM’s representation space via a trainable projection module.
Outcome: The proposed method improves LLM reasoning performance through supervised, parameter-efficient fine-tuning.
Fine-Tuning on Diverse Reasoning Chains Drives Within-Inference CoT Refinement in LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to generate multiple independent CoTs, combining them through ensembling or other post-hoc strategies, have been shown to be effective in boosting performance.
Approach: They propose a method where LLMs are fine-tuned to generate a sequence of Diverse Chains of Thought (DCoT) within a single inference step.
Outcome: The proposed model can generate multiple chains of thought within a single inference step without external feedback.
Probe Then Retrieve and Reason: Distilling Probing and Reasoning Capabilities into Smaller Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Recent research efforts have focused on distilling Large Language Models into Small Language Model (SLMs) however, the results of CoT distillation are inadequate for knowledge-intensive reasoning tasks.
Approach: They propose a retrieval-based framework which distills question probing and reasoning capabilities from Large Language Models into SLMs.
Outcome: The proposed framework improves probing and reasoning capabilities of large language models in knowledge-intensive reasoning tasks.
DICE: Structured Reasoning in LLMs through SLM-Guided Chain-of-Thought Correction (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) often prioritize reasoning over adherence to detailed instructions due to high computational costs and limited parameter access.
Approach: They propose a lightweight framework that guides small language models to refine LLMs’ outputs through chain-of-thought correction.
Outcome: The proposed framework improves the average format accuracy and content correctness of LLM outputs by 35.4% and 29.4%, respectively, achieving state-of-the-art (SOTA) performance over other competitive baselines.
Skip-Thinking: Chunk-wise Chain-of-Thought Distillation Enable Smaller Language Models to Reason Better and Faster (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods train small language models to learn long rationales in one iteration.
Approach: They propose a method that uses a heuristic search to divide rationale into internal chunks . they propose CWT, which uses CWt to focus SLM on learning from only one chunk per iteration.
Outcome: The proposed method can guide a large language model (LLM) in reasoning tasks.
On the Impact of Fine-Tuning on Chain-of-Thought Reasoning (2025.naacl-long)

Copied to clipboard

Challenge: Large language models have emerged as powerful tools for general intelligence, showcasing advanced natural language processing capabilities.
Approach: They propose to use supervised fine-tuning and Quantized Low-Rank Adapters to improve LLMs' task-specific performance to address privacy and safety risks.
Outcome: The proposed model improves the accuracy of the chain-of-thought reasonings across four datasets and demonstrates that the faithfulness of CoT reasoning decreases.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations