Challenge: Using the PhonologyBench benchmark, we assess tasks like rhyme word generation, g2p conversion, and syllable counting.
Approach: They evaluate phonological reasoning in text-based large language models using the PhonologyBench benchmark and a Pedagogically-motivated Participatory Chain-of-Thought prompt.
Outcome: The proposed model achieves up to 52% improvement and surpasses human baselines in certain tasks.

Similar Papers

Towards Understanding Chain-of-Thought Prompting: An Empirical Study of What Matters (2023.acl-long)

Copied to clipboard

Challenge: Chain-of-Thought (CoT) prompting can dramatically improve the multi-step reasoning abilities of large language models (LLMs).
Approach: They propose to use Chain-of-Thought (CoT) prompting to encourage the LLM to generate intermediate rationales for solving a problem by providing a series of reasoning steps in the demonstrations.
Outcome: The proposed model can generate coherent lines of reasoning even with invalid demonstrations while still generating coherent lines during inference.
Cue-CoT: Chain-of-thought Prompting for Responding to In-depth Dialogue Questions with LLMs (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing LLMs generate responses based on the dialogue context, overlooking the underlying linguistic cues about the user status exhibited in the context.
Approach: They propose a linguistic cue-based chain-of-thoughts method which enhances the LLMs inference with an intermediate reasoning step to find cues exhibited in the dialogue.
Outcome: The proposed method outperforms standard prompting methods on in-depth dialogue questions and linguistic cues exhibited in the context.
ChainLM: Empowering Large Language Models with Improved Chain-of-Thought Prompting (2024.lrec-main)

Copied to clipboard

Challenge: Existing CoT synthesis approaches focus on simpler reasoning tasks and result in inconsistent CoT prompts.
Approach: They propose a framework for automatic generation of superior CoT prompts based on three major evolution strategies . they propose 'step-level debating' method where multiple debaters discuss each reasoning step to arrive at the correct answer.
Outcome: The proposed framework can generate superior CoT prompts from a CoT dataset.
CoF-CoT: Enhancing Large Language Models with Coarse-to-Fine Chain-of-Thought Prompting for Multi-domain NLU Tasks (2023.emnlp-main)

Copied to clipboard

Challenge: Chain-of-Thought prompting is popular in reasoning tasks, but its application to Large Language Models (LLMs) in Natural Language Understanding (NLU) is under-explored.
Approach: They propose a Coarse-to-Fine Chain-of-Thought approach that breaks down NLU tasks into multiple reasoning steps where LLMs can learn to acquire essential concepts.
Outcome: The proposed approach is effective in assisting the LLMs adapt to multi-grained NLU tasks under zero-shot and few-shot multi-domain settings.
R3 Prompting: Review, Rephrase and Resolve for Chain-of-Thought Reasoning in Large Language Models under Noisy Context (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing studies have evaluated LLMs under noise-free context but the dilemma for LLM to produce inaccurate results under noisy context has not been fully investigated.
Approach: They propose a new method for CoT reasoning using Chain-of-Thought prompting that interacts with LLMs to perform key sentence extraction, variable declaration and answer prediction.
Outcome: The proposed method outperforms existing CoT prompting methods on five reasoning tasks under noisy context.
CAC-CoT: Connector-Aware Compact Chain-of-Thought for Efficient Reasoning Data Synthesis Across Dual-System Cognitive Tasks (2025.findings-emnlp)

Copied to clipboard

Challenge: Long chain-of-thought (CoT) prompting often slows or even degrades performance on fast, intuitive "System-1" tasks.
Approach: They introduce a method that deliberately restricts reasoning to a small, fixed set of connector phrases, steering the model toward concise and well-structured explanations.
Outcome: The method achieves 85% on GSM8K and 40% on GPQA while also surpassing the baseline by over 20%.
Boosting Language Models Reasoning with Chain-of-Knowledge Prompting (2024.acl-long)

Copied to clipboard

Challenge: Recent studies have shown that Chain-of-Thought (CoT) prompting can be effective on complex reasoning tasks but generates unfaithful and unfactual reasoning chains.
Approach: They propose a chain-of-knowledge prompting that elicits Large Language Models to generate explicit pieces of knowledge evidence in the form of structure triple.
Outcome: The proposed method improves commonsense, factual, symbolic, and arithmetic reasoning tasks by estimating the reliability of the reasoning chains in terms of factuality and faithfulness.
Self-prompted Chain-of-Thought on Large Language Models for Open-domain Multi-hop Reasoning (2023.findings-emnlp)

Copied to clipboard

Challenge: Existing open-domain question-answering methods lack quality assurance . existing methods lack scalability and poor diversity, hindering LLMs' capabilities .
Approach: They propose an open-domain multi-hop reasoning framework to answer multi-choice questions . they propose an adaptive sampler for in-context selection and self-prompted inference .
Outcome: The proposed framework surpasses the existing SOTA methods on large-scale datasets and doubles the zero-shot performance of small-scale LLMs.
What Makes Chain-of-Thought Prompting Effective? A Counterfactual Study (2023.findings-emnlp)

Copied to clipboard

Challenge: Using a few-shot prompt, we examine the effects of symbols and patterns on in-context learning in large language models.
Approach: They employ a counterfactual prompting approach by manipulating examples and testing the consequences on model behavior.
Outcome: The proposed approach allows us to understand the relative contributions of symbols and patterns on in-context learning.
Cross-lingual Prompting: Improving Zero-shot Chain-of-Thought Reasoning across Languages (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for zero-shot CoT are limited to a single language, making it difficult to generalize to other languages and hindering global development.
Approach: They introduce cross-lingual prompting (CLP) to improve zero-shot CoT reasoning across languages.
Outcome: The proposed method outperforms existing prompting methods on several benchmarks.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations