LLMs on interactive feature collections with implicit dynamic decision strategy (2025.coling-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) struggle to efficiently narrow down the search space . external engineered systems may not fully utilize the inherent problem-solving capabilities of LLMs . |
| Approach: | They propose to implicitly guide Large Language Models to enhance their interactive feature collection abilities within a single prompt. |
| Outcome: | The proposed approach improves the performance of large language models in real-world scenarios. |
Similar Papers
Enhancing Function-Calling Capabilities in LLMs: Strategies for Prompt Formats, Data Integration, and Multilingual Translation (2025.naacl-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have significantly advanced autonomous agents, particularly in zero-shot tool usage, also known as function calling. |
| Approach: | They propose to integrate function descriptions into prompt formats and introduce a new Decision Token for conditional prompts. |
| Outcome: | The proposed decision token improves function-calling accuracy and relevance detection and a translation pipeline overcomes multilingual limitations. |
From Implicit Exploration to Structured Reasoning: Guideline and Refinement for LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing models rely on implicit exploration, which leads to unstable reasoning paths and lack of error correction. |
| Approach: | They propose a framework that shifts from implicit exploration to structured reasoning through guideline and refinement. |
| Outcome: | The proposed model outperforms strong baselines on the Big-Bench Hard benchmark. |
Making Large Language Models Better Reasoners with Orchestrated Streaming Experiences (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent studies show that large language models can perform complex reasoning tasks without labeled data and unlabeled data. |
| Approach: | They propose a framework for solving reasoning tasks that store answers in a streaming experience pool and orchestrate helpful questions from the pool to assist itself in answering new questions. |
| Outcome: | The proposed framework can self-improve as it answers reasoning questions . it stores all answered reasoning questions and their reasoning steps in a streaming experience pool . |
Reasoning While Asking: Transforming Reasoning Large Language Models from Passive Solvers to Proactive Inquirers (2026.acl-long)
Copied to clipboard
| Challenge: | Existing reasoning-oriented LLMs lack a blind self-thinking paradigm . current models fail to recognize when their reasoning is underinformed or based on ambiguous user instructions . |
| Approach: | They propose a new reasoning paradigm that transforms LLMs into proactive inquirers that interleave reasoning with clarification. |
| Outcome: | The proposed model outperforms baseline models on mathematical reasoning, code generation, and document editing. |
Improving Large Language Models Function Calling and Interpretability via Guided-Structured Templates (2025.emnlp-main)
Copied to clipboard
Hy Dang, Tianyi Liu, Zhuofeng Wu, Jingfeng Yang, Haoming Jiang, Tao Yang, Pei Chen, Zhengyang Wang, Helen Wang, Huasheng Li, Bing Yin, Meng Jiang
| Challenge: | Large language models (LLMs) have strong reasoning and tool-use capabilities, yet fail in real-world tool-interactions due to incorrect parameterization, poor tool selection, or misinterpretation of user intent. |
| Approach: | They propose a curriculum-inspired framework that leverages structured reasoning templates to guide LLMs through more deliberate step-by-step instructions for generating function calls. |
| Outcome: | The proposed framework reduces tool-use errors and improves interpretability and transparency of tool-using agents. |
AMAS: Adaptively Determining Communication Topology for LLM-based Multi-agent System (2025.emnlp-industry)
Copied to clipboard
| Challenge: | Large language models (LLMs) have revolutionized natural language processing, but their practical implementation as autonomous multi-agent systems remains fraught with unresolved challenges. |
| Approach: | They propose a dynamic graph selector that redefines LLM-based MAS by exploiting the intrinsic properties of individual inputs to intelligently direct query trajectories. |
| Outcome: | The proposed framework exceeds state-of-the-art approaches in question answering, mathematical deduction, and code generation benchmarks. |
DIVKNOWQA: Assessing the Reasoning Ability of LLMs via Open-Domain Question Answering over Knowledge Base and Text (2024.findings-naacl)
Copied to clipboard
| Challenge: | Retrievalaugmented LLMs have been used to ground LLM in external knowledge . a gap exists in the current landscape regarding the effectiveness of grounding LLM on heterogeneous knowledge sources. |
| Approach: | They propose a model that uses symbolic language to generate symbolic queries . they use a dataset that is generated using predefined reasoning chains and human annotation . |
| Outcome: | The proposed model outperforms previous approaches by a significant margin in QA tasks over text. |
Enhancing Text-to-SQL Capabilities of Large Language Models: A Study on Prompt Design Strategies (2023.findings-emnlp)
Copied to clipboard
Linyong Nan, Yilun Zhao, Weijin Zou, Narutatsu Ri, Jaesung Tae, Ellen Zhang, Arman Cohan, Dragomir Radev
| Challenge: | In-context learning (ICL) is a new approach to natural language processing tasks that rely on large language models to make predictions based on context . recent studies have shown that neural symbolic design is the preferred choice for question answering systems because of its limited working memory and unreliable long-term memory. |
| Approach: | They propose to extend in-context learning to question answering tasks that utilize structured knowledge sources and to explore various prompt design strategies for employing LLMs. |
| Outcome: | The proposed approach outperforms the state-of-the-art system by 2.5 points and the best fine-tuned system by 5.1 points on the Spider dataset. |
Mapping the Minds of LLMs: A Graph-Based Analysis of Reasoning LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) often display unstable behaviors, e.g., hallucinating unsupported premises, overthinking simple tasks, and displaying higher sensitivity to prompt variations. |
| Approach: | They propose a graph-based analytical framework that clusters long, verbose CoT outputs into semantically coherent reasoning steps, then constructs directed reasoning graphs to capture contextual and logical dependencies among these steps. |
| Outcome: | The proposed framework enables quantitative evaluation of internal reasoning structure and quality beyond conventional metrics and provides practical insights for prompt engineering and cognitive analysis of LLMs. |
A Survey on LLM-powered Agents for Recommender Systems (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models have demonstrated remarkable capabilities in natural language understanding, reasoning, and generation. |
| Approach: | They present a comprehensive synthesis of large language models and their applications . they dissect a four-module agent architecture and review representative designs . |
| Outcome: | The proposed models address fundamental challenges in traditional recommender systems . they include limited comprehension of complex user intents, insufficient interaction capabilities . |