Leveraging Training Data in Few-Shot Prompting for Numerical Reasoning (2023.findings-acl)
Copied to clipboard
| Challenge: | Chain-of-thought (CoT) prompts can be challenging to design for arithmetic word problem solving. |
| Approach: | They propose to use training data to replace CoT with programs as the reasoning step . their results show that leveraging training data can improve generalization ability of prompts . |
| Outcome: | The proposed methods improve the generalization ability of prompts and the performance of fine-tuned smaller models in arithmetic word problem solving. |
Similar Papers
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. |
| Approach: | They propose a plan-and-solve (PS) prompting that includes a few manual steps to generate reasoning steps and improves the quality of generated reasoning steps. |
| Outcome: | The proposed strategy outperforms Zero-shot-CoT on ten reasoning problems and has comparable performance to 8-shot CoT prompting on the math reasoning problem. |
SMASH: Improving SMAll Language Models’ Few-SHot Ability with Prompt-Based Distillation (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale language models with prompts have shown remarkable performance on few-shot learning. |
| Approach: | They propose an approach to improve SMAll language models’ few-SHot ability by training on intermediate tasks before prompt-based fine-tuning on downstream tasks. |
| Outcome: | The proposed model improves on sentence-pair and sentiment classification tasks by training on intermediate tasks before fine-tuning on downstream tasks. |
Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for question generation over knowledge bases rely on annotated data for fine-tuning . emergence of Large Language Models (LLMs) has shown impressive generalization ability in few-shot tasks. |
| Approach: | They propose to use a logical form to generate a question in a reasoning problem . they propose to extend the prompting method into a method that can generate questions in logical forms . |
| Outcome: | The proposed method outperforms baselines on three public KBQG datasets. |
PIAST: Rapid Prompting with In-context Augmentation for Scarce Training data (2026.acl-long)
Copied to clipboard
| Challenge: | Existing prompt generation methods are impractical in time and data constrained settings. |
| Approach: | They propose a fast automatic prompt construction algorithm that augments human instructions by generating a small set of few shot examples. |
| Outcome: | The proposed method outperforms existing prompting methods on classification, simplification, and MedQA. |
Prompting-based Synthetic Data Generation for Few-Shot Question Answering (2024.lrec-main)
Copied to clipboard
| Challenge: | Language models have boosted the performance of Question Answering, but data annotation is costly. |
| Approach: | They propose to use large language models to improve Question Answering performance . they argue that domain-agnostic knowledge from LMs is sufficient to create a well-curated dataset. |
| Outcome: | The proposed model outperforms state-of-the-art approaches on few-shot Question Answering. |
Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for zero-shot CoT are limited to a single language, making it difficult to generalize to other languages and hindering global development. |
| Approach: | They introduce cross-lingual prompting (CLP) to improve zero-shot CoT reasoning across languages. |
| Outcome: | The proposed method outperforms existing prompting methods on several benchmarks. |
What Makes Chain-of-Thought Prompting Effective? A Counterfactual Study (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using a few-shot prompt, we examine the effects of symbols and patterns on in-context learning in large language models. |
| Approach: | They employ a counterfactual prompting approach by manipulating examples and testing the consequences on model behavior. |
| Outcome: | The proposed approach allows us to understand the relative contributions of symbols and patterns on in-context learning. |
StablePT : Towards Stable Prompting for Few-shot Learning via Input Separation (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing studies on prompt tuning have shown that language models can be effective few-shot learners with prompting. |
| Approach: | They propose to treat the hard prompt and soft prompt as separate inputs to mitigate noise brought by prompt initialization. |
| Outcome: | Experimental results show that the proposed method outperforms state-of-the-art methods by 6.97% in accuracy and reduces the standard deviation by 1.92 on average. |
CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought prompting is popular in reasoning tasks, but its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. |
| Approach: | They propose a Coarse-to-Fine Chain-of-Thought approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire essential concepts. |
| Outcome: | The proposed approach is effective in assisting the LLMs adapt to multi-grained NLU tasks under zero-shot and few-shot multi-domain settings. |
Prompt-Level Distillation: A Non-Parametric Alternative to Model Fine-Tuning for Efficient Reasoning (2026.acl-industry)
Copied to clipboard
| Challenge: | Advanced reasoning typically requires Chain-of-Thought prompting, which is accurate but incurs prohibitive latency and substantial test-time inference costs. |
| Approach: | They propose to extract explicit reasoning patterns from a Teacher model and organize them into a structured list of expressive instructions for the Student model’s System Prompt. |
| Outcome: | Evaluated using Gemma-3 4B, the proposed model improves Macro F1 scores on StereoSet and Contract-NLI while increasing LogiQA accuracy to 70%. |