LSEG: A Fine-tuning Free Method for NL2FOL via Logic-Structure and Entropy Guided Inference Controlling (2026.findings-acl)
Copied to clipboard
| Challenge: | Large language models struggle with natural language to first order logic (NL2FOL) translation due to logical hallucination. |
| Approach: | They propose a fine-tuning free framework to correct hidden state deviation by leveraging logical stability across logic preserving perturbations of the input. |
| Outcome: | The proposed framework improves logical consistency during inference and improves accuracy over baselines. |
Similar Papers
NL2Logic: AST-Guided Translation of Natural Language into First-Order Logic with Large Language Models (2026.findings-eacl)
Copied to clipboard
| Challenge: | Structured reasoning approaches that parse first-order logic rules from natural language lack syntax control and semantic faithfulness. |
| Approach: | They propose a structured reasoning paradigm that parses first-order logic rules from natural language and delegates inference to automated solvers. |
| Outcome: | a proposed framework parses first-order logic rules from natural language and delegates inference to automated solvers. |
Dissecting Logical Reasoning in LLMs: A Fine-Grained Evaluation and Supervision Study (2025.findings-emnlp)
Copied to clipboard
Yujun Zhou, Jiayi Ye, Zipeng Ling, Yufei Han, Yue Huang, Haomin Zhuang, Zhenwen Liang, Kehan Guo, Taicheng Guo, Xiangqi Wang, Xiangliang Zhang
| Challenge: | Existing benchmarks that rely on final-answer accuracy fail to capture the quality of the reasoning process. |
| Approach: | They propose a fine-grained evaluation framework that assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
| Outcome: | The proposed framework assesses logical reasoning across three dimensions: overall accuracy, stepwise soundness, and representation-level probing. |
Harnessing the Power of Large Language Models for Natural Language to First-Order Logic Translation (2024.acl-long)
Copied to clipboard
| Challenge: | Logic-based approaches to reasoning have lost popularity due to limited scalability and coverage. |
| Approach: | They present a dataset of 28K sentence-level NL-FOL pairs from GPT4 and a LogicLLaMA2-7B/13B fine-tuned on MALLS for NL translation. |
| Outcome: | The proposed model can be used standalone or to correct previously generated rules by GPT3.5. |
Logical Natural Language Generation from Open-Domain Tables (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on neural natural language generation focus on surface-level realizations with limited emphasis on logical inference. |
| Approach: | They propose a task where a model is tasked with generating natural language statements that can be logically entailed by facts in an open-domain semi-structured table. |
| Outcome: | The proposed task is based on the existing TabFact dataset with a wide range of logical/symbolic inferences. |
Logits-Based Finetuning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for developing compact and efficient large language models lack token-level dependencies and linguistic diversity. |
| Approach: | They propose a logits-based fine-tuning framework that integrates supervised learning and knowledge distillation to build enriched training targets using teacher logits and ground truth labels. |
| Outcome: | The proposed method outperforms existing methods on a large-scale logits dataset and a series of science-focused models. |
Complexity-aware fine-tuning (2026.findings-eacl)
Copied to clipboard
| Challenge: | General-purpose Large Language Models (LLMs) are often fine-tuned through supervised fine- tuning (SFT) to enhance performance in specific domains. |
| Approach: | They propose a novel approach that uses reasoning only for complex data identified by entropy to refine large language models. |
| Outcome: | The proposed model outperforms the standard SFT approach while using 81% less data. |
SafeMERGE: Preserving Safety Alignment in Fine-Tuned Large Language Models via Selective Layer-Wise Model Merging (2026.findings-acl)
Copied to clipboard
| Challenge: | Recent studies show that fine-tuning can erode safety alignment, causing LLMs to respond to harmful or unethical prompts. |
| Approach: | They propose a lightweight framework that restores safety while maintaining downstream performance. |
| Outcome: | The proposed framework reduces harmful outputs compared to other defenses, with negligible impact on utility. |
Hi-ZFO: Hierarchical Zeroth- and First-Order LLM Fine-Tuning via Importance-Guided Tensor Selection (2026.findings-acl)
Copied to clipboard
| Challenge: | generative tasks require a high degree of exploratory capacity, but zeroth-order methods suffer from slow convergence . generative task-specific methods tend to converge toward local minima, causing noise and inefficient estimation . |
| Approach: | They propose a framework that synergizes FO precision with exploratory capability of ZO estimation. |
| Outcome: | The proposed framework synergizes precision of FO gradients with exploratory capability of ZO estimation. |
Noise-Robust Fine-Tuning of Pretrained Language Models via External Guidance (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Pretrained Language Models (PLMs) are advanced but data labels are noisy due to the complex annotation process. |
| Approach: | They propose a framework for fine-tuning PLMs using noisy labels that incorporates guidance from Large Language Models like ChatGPT. |
| Outcome: | Experiments on synthetic and real-world noisy datasets show that the proposed framework outperforms the state-of-the-art framework. |
Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to align reasoning abilities between Large Language Models and Smaller Language Model are supervised fine-tuning and preference optimization. |
| Approach: | They propose a method that elicits Smaller Language Models to self-improve their reasoning abilities via preference optimization. |
| Outcome: | The proposed method outperforms Instruction-tuning on commonsense and math reasoning tasks on common and math scenarios. |