Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for zero-shot CoT are limited to a single language, making it difficult to generalize to other languages and hindering global development. |
| Approach: | They introduce cross-lingual prompting (CLP) to improve zero-shot CoT reasoning across languages. |
| Outcome: | The proposed method outperforms existing prompting methods on several benchmarks. |
Similar Papers
Plan-and-Solve Prompting: Improving Zero-Shot Chain-of-Thought Reasoning by Large Language Models (2023.acl-long)
Copied to clipboard
| Challenge: | Large language models (LLMs) have recently been shown to deliver impressive performance in various NLP tasks. |
| Approach: | They propose a plan-and-solve (PS) prompting that includes a few manual steps to generate reasoning steps and improves the quality of generated reasoning steps. |
| Outcome: | The proposed strategy outperforms Zero-shot-CoT on ten reasoning problems and has comparable performance to 8-shot CoT prompting on the math reasoning problem. |
A Tree-of-Thoughts to Broaden Multi-step Reasoning across Languages (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing methods for eliciting Large Language Models (LLMs) to solve complex tasks are limited to English due to the imbalance in the distribution of pre-training data. |
| Approach: | They propose a method for aligning Cross-lingual CoT reasoning across languages . they propose eliciting Large Language Models to solve complex tasks step-by-step . |
| Outcome: | The proposed method outperforms existing prompting methods by reducing interactions and achieving state-of-the-art performance. |
Disentangling Language Understanding and Reasoning Structures in Cross-lingual Chain-of-Thought Prompting (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study has shown that cross-lingual chain-of-thought prompting improves learning in low-resource languages. |
| Approach: | They examine whether benefits of cross-lingual prompting arise from language-specific reasoning structures . authors employ neuron intervention and perturbation techniques to analyze and deactivate language-related reasoning neurons . |
| Outcome: | The proposed study shows that language-specific reasoning structures are essential for reasoning in each language, but have minimal effect on reasoning in other languages. |
Reasoning for Translation: Comparative Analysis of Chain-of-Thought and Tree-of-Thought Prompting for LLM Translation (2025.acl-srw)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have been used for specialized tasks but their application to machine translation has received little attention. |
| Approach: | They evaluate reasoning-based prompting strategies across multiple language pairs and domains and measure their effect on translation quality. |
| Outcome: | The proposed prompting strategies outperform traditional prompting methods across language pairs and domains and achieve improvements of up to 6.4 BLs. |
Tab-CoT: Zero-shot Tabular Chain of Thought (2023.findings-acl)
Copied to clipboard
| Challenge: | Recent efforts to encourage more structured reasoning procedures to be captured have shown that chain-of-though (CoT) prompting methods can be effective in NLP tasks. |
| Approach: | They propose a tabular-format CoT prompting method that allows the complex reasoning process to be explicitly modeled in a highly structured manner. |
| Outcome: | The proposed method shows impressive performance improvements on a range of reasoning tasks. |
AutoCAP: Towards Automatic Cross-lingual Alignment Planning for Zero-shot Chain-of-Thought (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing approaches to cross-lingual chain-of-thought integrate reasoning knowledge from different languages, but they still rely on manual language specification and weight allocation. |
| Approach: | They propose an automatic cross-lingual alignment planning framework that integrates reasoning knowledge from different languages. |
| Outcome: | The proposed framework surpasses existing methods that require manual effort to integrate languages. |
Enhancing Zero-shot Chain of Thought Prompting via Uncertainty-Guided Strategy Selection (2025.coling-main)
Copied to clipboard
Shanu Kumar, Saish Mendke, Karody Lubna Abdul Rahman, Santosh Kurasa, Parag Agrawal, Sandipan Dandapat
| Challenge: | Existing methods for chain-of-thought (CoT) prompting are limited by handcrafted demonstrations and trigger phrases are prone to inaccuracies. |
| Approach: | They propose a method that generates rationales using a trigger phrase to select effective demonstrations without accessing model parameters. |
| Outcome: | The proposed method outperforms existing methods across four reasoning benchmarks and is robust and scalable. |
Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters (2023.acl-long)
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs). |
| Approach: | They propose to use Chain-of-Thought (CoT) prompting to encourage the LLM to generate intermediate rationales for solving a problem by providing a series of reasoning steps in the demonstrations. |
| Outcome: | The proposed model can generate coherent lines of reasoning even with invalid demonstrations while still generating coherent lines during inference. |
CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks (2023.emnlp-main)
Copied to clipboard
| Challenge: | Chain-of-Thought prompting is popular in reasoning tasks, but its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored. |
| Approach: | They propose a Coarse-to-Fine Chain-of-Thought approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire essential concepts. |
| Outcome: | The proposed approach is effective in assisting the LLMs adapt to multi-grained NLU tasks under zero-shot and few-shot multi-domain settings. |
What Makes Chain-of-Thought Prompting Effective? A Counterfactual Study (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Using a few-shot prompt, we examine the effects of symbols and patterns on in-context learning in large language models. |
| Approach: | They employ a counterfactual prompting approach by manipulating examples and testing the consequences on model behavior. |
| Outcome: | The proposed approach allows us to understand the relative contributions of symbols and patterns on in-context learning. |