SEGO: Sequential Subgoal Optimization for Mathematical Problem-Solving (2024.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated impressive capabilities across a wide range of tasks, including mathematical problem-solving. |
| Approach: | They propose a framework that connects the subgoal breakdown process and the probability of solving problems by identifying better subgoals with theoretical guarantees. |
| Outcome: | The proposed framework outperforms existing methods on two benchmarks, GSM8K and MATH, highlighting the potential of SEGO in AI-driven mathematical problem-solving. |
Similar Papers
SELFGOAL: Your Language Agents Already Know How to Achieve High-level Goals (2025.naacl-long)
Copied to clipboard
Ruihan Yang, Jiangjie Chen, Yikai Zhang, Siyu Yuan, Aili Chen, Kyle Richardson, Yanghua Xiao, Deqing Yang
| Challenge: | Existing approaches to improve the performance of language agents without training are not available. |
| Approach: | They propose an automatic approach to break down high-level goals into tree structure of more practical subgoals during interaction with environments while identifying the most useful subgoal. |
| Outcome: | The proposed approach significantly improves the performance of language agents across various tasks, including competitive, cooperative, and deferred feedback environments. |
Efficient Sequential Decision Making with Large Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing approaches to retrain or finetune large language models (LLMs) for decision making suffer from computational burden of gradient updates. |
| Approach: | They propose a model selection algorithm that leverages online model selection algorithms to efficiently incorporate LLMs agents into sequential decision making. |
| Outcome: | The proposed approach outperforms both traditional decision making algorithms and vanilla LLM agents on a large-scale Amazon dataset. |
SDGO: Self-Discrimination-Guided Optimization for Consistent Safety in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) excel at various tasks but are vulnerable to jailbreak attacks that induce harmful content generation. |
| Approach: | They propose a reinforcement learning framework that leverages the model’s own discrimination capabilities as a reward signal to enhance generation safety through iterative self-improvement. |
| Outcome: | The proposed framework improves model safety by iterative self-improvement without additional annotated data or external models during training phase. |
seqBench: A Tunable Benchmark to Quantify Sequential Reasoning Limits of LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | **seqBench** allows systematic variation of several key complexity dimensions. |
| Approach: | They introduce a parametrized benchmark for probing sequential reasoning limits in Large Language Models through precise, multi-dimensional control over several key complexity dimensions. |
| Outcome: | The framework allows systematic variation of logical depth, backtracking requirements and noise ratio on state-of-the-art LLMs. |
Neuron-Level Sequential Editing for Large Language Models (2025.acl-long)
Copied to clipboard
Houcheng Jiang, Junfeng Fang, Tianyu Zhang, Baolong Bi, An Zhang, Ruipeng Wang, Tao Liang, Xiang Wang
| Challenge: | Existing model editing methods focus on single-round editing and often face significant challenges in sequential model editing. |
| Approach: | They propose a model editing method that optimizes the target layer’s hidden states using the model’s original weights to prevent model failure. |
| Outcome: | The proposed method outperforms existing model editing methods and is available on the open-source platform 4open.science. |
Compound AI Systems Optimization: A Survey of Methods, Challenges, and Future Directions (2025.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large language models (LLMs) and AI systems have led to a paradigm shift in the design and optimization of complex workflows. |
| Approach: | They propose a systematic review of recent progress in optimizing compound AI systems . they formalize the notion of compound AI system optimization and classify existing methods along several key dimensions . |
| Outcome: | The proposed methods outperform existing methods in the field of compound AI and highlight open research challenges and future directions. |
Take a Break in the Middle: Investigating Subgoals towards Hierarchical Script Generation (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing work assumes that events are sequentially arranged in a script, while this assumption leads to linear generation that is far from sufficient for comprehensively acquiring the representation about how events are organized towards a task goal. |
| Approach: | They propose to extend goal-oriented Script Generation task from the perspective of cognitive theory by incorporating subgoals into hierarchical script generation. |
| Outcome: | The proposed task is based on a new dataset and human evaluation metrics. |
Hallucination Detection for Generative Large Language Models by Bayesian Sequential Estimation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for detecting hallucinations require large numbers of observations to be retrieved, increasing response times. |
| Approach: | They propose a framework that leverages Bayesian sequential analysis to optimize the trade-off between costs and benefits during the hallucination detection process. |
| Outcome: | The proposed framework surpasses existing methods in efficiency and precision of hallucination detection. |
Deep Bayesian Learning and Understanding (C18-3)
Copied to clipboard
| Challenge: | COLING 2018 is a conference for researchers and practitioners working on machine learning and deep learning. |
| Approach: | a tutorial on machine learning and deep learning will be presented at COLING 2018 . the tutorial will focus on statistical models, deep neural networks, sequential learning and natural language understanding . |
| Outcome: | This tutorial will present the latest advances in deep Bayesian and sequential learning at COLING 2018 . |
Deep Bayesian Natural Language Processing (P19-4)
Copied to clipboard
| Challenge: | Introduction to deep Bayesian learning for natural language addresses the fundamentals of statistical models and neural networks. |
| Approach: | This tutorial addresses the advances in deep Bayesian learning for natural language . it focuses on advanced Bayessian models and deep models . authors present case studies and domain applications to tackle different issues . |
| Outcome: | This tutorial focuses on advanced Bayesian models and deep models for natural language . case studies and domain applications are presented to tackle different issues in deep Bayessian processing, learning and understanding. |