Fundamental Reasoning Paradigms Induce Out-of-Domain Generalization in Language Models (2026.findings-acl)
Copied to clipboard
Mingzi Cao, Xingwei Tan, Mahmud Elahi Akhter, Marco Valentino, Maria Liakata, Xi Wang, Nikolaos Aletras
| Challenge: | Deduction, induction, and abduction are fundamental reasoning paradigms, core for human logical thinking. |
| Approach: | They propose to use a dataset of symbolic tasks to induce deductive skills into large language models (LLMs) they then use FT to fine-tune models to improve OOD generalization . |
| Outcome: | The proposed approach yields strong generalizability with substantial performance gains (up to 14.60) across realistic out-of-domain tasks. |
Similar Papers
A Comprehensive Evaluation of Inductive Reasoning Capabilities and Problem Solving in Large Language Models (2024.findings-eacl)
Copied to clipboard
| Challenge: | Inductive reasoning is fundamental to both human and artificial intelligence. |
| Approach: | They evaluated the inductive reasoning abilities of current Large Language Models (LLMs) and their performance on symbolic tasks. |
| Outcome: | The proposed models fail on symbolic tasks and show that chain-of-thought prompts help them by decomposing the problem-solving process, but the LLMs learn limitedly. |
A Survey of Inductive Reasoning for Large Language Models (2026.acl-long)
Copied to clipboard
Kedi Chen, Dezhao Ruan, Yuhao Dan, Yaoting Wang, Siyu Yan, Xuecheng Wu, Yinqi Zhang, Qin Chen, Jie Zhou, Liang He, Biqing Qi, Linyang Li, Qipeng Guo, Xiaoming Shi, Wei Zhang
| Challenge: | Inductive reasoning is an important task for large language models (LLMs). |
| Approach: | They propose a survey of inductive reasoning for large language models . they categorize methods into three main areas: post-training enhancement, test-time exploration, and data augmentation. |
| Outcome: | The proposed method improves inductive reasoning in large language models. |
Evaluating Generalization Capability of Language Models across Abductive, Deductive and Inductive Logical Reasoning (2025.coling-main)
Copied to clipboard
| Challenge: | Recent research in language models (LMs) have demonstrated remarkable performance on many natural language tasks, yet to what extent LMs possess the capability of generalizing to unseen logical rules remains unclear. |
| Approach: | They propose to use a dataset to assess the generalization capabilities of LMs on ADI reasoning to assess their generalization abilities. |
| Outcome: | The proposed dataset shows that LMs perform poorly on ADI reasoning tasks and lacks generalization capabilities. |
Injecting Domain-Specific Knowledge into Large Language Models: A Comprehensive Survey (2025.findings-emnlp)
Copied to clipboard
| Challenge: | specialized LLMs are often limited in domain-specific applications that require specialized knowledge. |
| Approach: | They provide a comprehensive overview of four key methods to enhance large language models by integrating domain-specific knowledge. |
| Outcome: | The proposed methods are categorized into four key approaches: dynamic knowledge injection, static knowledge embedding, modular adapters, and prompt optimization. |
On the Role of Model Prior in Real-World Inductive Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing studies have evaluated the inductive reasoning capabilities of Large Language Models (LLMs) by evaluating their ability to generate textual hypotheses based on in-context input-output pairs and test these hypothese based upon unseen examples. |
| Approach: | They evaluated three inductive reasoning strategies across five real-world tasks with three LLMs and found that hypothesis generation is primarily driven by the model’s inherent priors. |
| Outcome: | The proposed models generate high-quality hypotheses that can generalize to new instances when guided by in-context demonstrations. |
Complex Reasoning in Natural Language (2023.acl-tutorials)
Copied to clipboard
| Challenge: | Recent research shows that pretrained language models are often brittle for complex reasoning tasks. |
| Approach: | They propose to use pre-trained language models to teach machines to reason over texts . they will review recent promising approaches to tackling complex reasoning tasks . |
| Outcome: | This tutorial reviews promising approaches to complex reasoning tasks . it reviews the methods that can be used to augment models with robustness . |
Towards Reasoning in Large Language Models: A Survey (2023.findings-acl)
Copied to clipboard
| Challenge: | Reasoning is a fundamental aspect of human intelligence that plays a crucial role in many intellectual activities. |
| Approach: | They propose to improve LLMs' ability to elicit reasoning by providing exemplars or prompts to model reasoning. |
| Outcome: | This paper provides a comprehensive overview of the state of knowledge on reasoning in large language models. |
Do Language Models Perform Generalizable Commonsense Inference? (2021.findings-acl)
Copied to clipboard
| Challenge: | Recent work has applied pretrained language models to populate commonsense knowledge graphs (CKGs) but there is a lack of understanding on their generalization to multiple CKGs, unseen relations, and novel entities. |
| Approach: | They analyze the ability of pretrained language models to perform generalizable commonsense inference in terms of knowledge capacity, transferability and induction. |
| Outcome: | The proposed models can adapt to different schemas defined by multiple CKGs but fail to generalize to new relations. |
LogiDynamics: Unraveling the Dynamics of Inductive, Abductive and Deductive Logical Inferences in LLM Reasoning (2025.emnlp-main)
Copied to clipboard
Tianshi Zheng, Cheng Jiayang, Chunyang Li, Haochen Shi, Zihao Wang, Jiaxin Bai, Yangqiu Song, Ginny Wong, Simon See
| Challenge: | Modern large language models (LLMs) employ diverse logical inference mechanisms for reasoning. |
| Approach: | They analyze the comparative dynamics of inductive (System 1) versus abductive/deductive (system 2) inference in large language models by using a controlled analogical reasoning environment and a MCQ/free-text task format. |
| Outcome: | The proposed methods can significantly scale LLM reasoning. |
AbductionRules: Training Transformers to Explain Unexpected Inputs (2022.findings-acl)
Copied to clipboard
| Challenge: | AbductionRules is a set of natural language datasets designed to train and test generalisable abduction over natural-language knowledge bases. |
| Approach: | They propose to train and test generalisable abduction over natural-language knowledge bases by using natural language datasets to fine tune pre-trained Transformers. |
| Outcome: | The proposed models learned generalisable abduction techniques but also exploited the structure of the datasets. |