| Challenge: | Existing studies have evaluated the inductive reasoning capabilities of Large Language Models (LLMs) by evaluating their ability to generate textual hypotheses based on in-context input-output pairs and test these hypothese based upon unseen examples. |
| Approach: | They evaluated three inductive reasoning strategies across five real-world tasks with three LLMs and found that hypothesis generation is primarily driven by the model’s inherent priors. |
| Outcome: | The proposed models generate high-quality hypotheses that can generalize to new instances when guided by in-context demonstrations. |
Similar Papers
A Survey of Inductive Reasoning for Large Language Models (2026.acl-long)
Copied to clipboard
Kedi Chen, Dezhao Ruan, Yuhao Dan, Yaoting Wang, Siyu Yan, Xuecheng Wu, Yinqi Zhang, Qin Chen, Jie Zhou, Liang He, Biqing Qi, Linyang Li, Qipeng Guo, Xiaoming Shi, Wei Zhang
| Challenge: | Inductive reasoning is an important task for large language models (LLMs). |
| Approach: | They propose a survey of inductive reasoning for large language models . they categorize methods into three main areas: post-training enhancement, test-time exploration, and data augmentation. |
| Outcome: | The proposed method improves inductive reasoning in large language models. |
A Comprehensive Evaluation of Inductive Reasoning Capabilities and Problem Solving in Large Language Models (2024.findings-eacl)
Copied to clipboard
| Challenge: | Inductive reasoning is fundamental to both human and artificial intelligence. |
| Approach: | They evaluated the inductive reasoning abilities of current Large Language Models (LLMs) and their performance on symbolic tasks. |
| Outcome: | The proposed models fail on symbolic tasks and show that chain-of-thought prompts help them by decomposing the problem-solving process, but the LLMs learn limitedly. |
On LLM-Based Scientific Inductive Reasoning Beyond Equations (2025.emnlp-main)
Copied to clipboard
Brian S. Lin, Jiaxin Yuan, Zihan Zhou, Shouli Wang, Shuo Wang, Cunliang Kong, Qi Shi, Yuxuan Li, Liner Yang, Zhiyuan Liu, Maosong Sun
| Challenge: | Existing research on inductive reasoning models emphasizes rule design without grounding them in specific scenarios. |
| Approach: | They propose to use LLMs to learn underlying patterns from limited examples in entirely new environments. |
| Outcome: | The proposed benchmark evaluates the inductive reasoning abilities of large language models in scientific settings. |
Fundamental Reasoning Paradigms Induce Out-of-Domain Generalization in Language Models (2026.findings-acl)
Copied to clipboard
Mingzi Cao, Xingwei Tan, Mahmud Elahi Akhter, Marco Valentino, Maria Liakata, Xi Wang, Nikolaos Aletras
| Challenge: | Deduction, induction, and abduction are fundamental reasoning paradigms, core for human logical thinking. |
| Approach: | They propose to use a dataset of symbolic tasks to induce deductive skills into large language models (LLMs) they then use FT to fine-tune models to improve OOD generalization . |
| Outcome: | The proposed approach yields strong generalizability with substantial performance gains (up to 14.60) across realistic out-of-domain tasks. |
Towards Reasoning in Large Language Models: A Survey (2023.findings-acl)
Copied to clipboard
| Challenge: | Reasoning is a fundamental aspect of human intelligence that plays a crucial role in many intellectual activities. |
| Approach: | They propose to improve LLMs' ability to elicit reasoning by providing exemplars or prompts to model reasoning. |
| Outcome: | This paper provides a comprehensive overview of the state of knowledge on reasoning in large language models. |
What Do Language Models Learn in Context? The Structured Task Hypothesis. (2024.acl-long)
Copied to clipboard
| Challenge: | Pre-trained large language models have exhibited an impressive ability to learn in context across various domains, e.g., code generation, education, medicine and even medicine. |
| Approach: | They taxonomize existing candidate theories into three competing hypotheses that explain LLMs’ ability to learn in context. |
| Outcome: | The proposed model can learn a task from in-context examples presented in a demonstration and generalize it to the prompt. |
Current Advances in LLM Reasoning (2026.acl-tutorials)
Copied to clipboard
| Challenge: | This tutorial examines comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) advanced inference time methods and post-training methods that aim to make LLMs think more like humans are discussed in this tutorial. |
| Approach: | This tutorial explores comprehensive evaluation strategies to assess the reasoning abilities of large language models (LLMs) and discusses two types of methods to improve models’ reasoning: advanced inference time methods, structured and self-improvement inference methods, and post-training methods, such as RLHF, DPO, and GRPO. |
| Outcome: | This tutorial examines evaluation strategies to assess the reasoning abilities of large language models and discusses two types of methods to improve models’ reasoning. |
Can Input Attributions Explain Inductive Reasoning in In-Context Learning? (2025.findings-acl)
Copied to clipboard
| Challenge: | interpreting the internal process of neural models has long been a challenge . despite rapid progress, there are still questions bridging the IA and MI eras . |
| Approach: | They propose to use input attribution methods to interpret in-context learning . they find that a certain simple IA method works best in large models . |
| Outcome: | The proposed method is the best for interpreting LLM-based ICL, but the larger the model, the harder it is to interpret it. |
Out-of-Context Reasoning in Large Language Models (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a lightweight technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
| Approach: | They propose a lightweight technique that trains only new token embeddings on axioms . they train only new embeddables and evaluate them on unseen tasks . |
| Outcome: | The proposed technique trains only new token embeddings on axioms and evaluates them on unseen tasks. |
Prompting Large Language Models for Counterfactual Generation: An Empirical Study (2024.lrec-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) have made remarkable progress in a wide range of natural language understanding and generation tasks, but their ability to generate counterfactuals has not been examined systematically. |
| Approach: | They propose a framework to evaluate LLMs' ability to generate counterfactuals based on key factors including intrinsic properties and prompt design. |
| Outcome: | The proposed framework examines the strengths and weaknesses of large language models (LLMs) and identifies factors that influence their ability to generate counterfactuals. |