Papers with ToolBench
Knowledge is Not Enough: Injecting RL Skills for Continual Adaptation (2026.acl-long)
Copied to clipboard
| Challenge: | Large Language Models face the "knowledge cutoff" problem because their parametric memory remains frozen after pretraining, preventing them from natively internalizing new information or tools on the fly. |
| Approach: | They propose a framework that supports modular skill transfer for efficient and effective knowledge adaptation by extracting a domain-agnostic **Skill Vector from a source domain. |
| Outcome: | Experiments on knowledge-incorporation QA (SQuAD, LooGLE) and agentic tool-use benchmarks show that the proposed framework outperforms state-of-the-art self-editing SFT by 9.9 points. |
LLMs in the Imaginarium: Tool Learning through Simulated Trial and Error (2024.acl-long)
Copied to clipboard
| Challenge: | Existing work on tool-augmented LLMs focuses on the broad coverage of tools and the flexibility of adding new tools. |
| Approach: | They propose a biologically inspired method for tool-augmented LLMs that orchestrates three key mechanisms for successful tool use behaviors in the biological system: trial and error, imagination, and memory. |
| Outcome: | The proposed method improves tool learning for LLMs under both in-context learning and fine-tuning settings, bringing a boost of 46.7% to Mistral-Instruct-7B and outperforms GPT-4. |
StableToolBench: Towards Stable Large-Scale Benchmarking on Tool Learning of Large Language Models (2024.findings-acl)
Copied to clipboard
Zhicheng Guo, Sijie Cheng, Hao Wang, Shihao Liang, Yujia Qin, Peng Li, Zhiyuan Liu, Maosong Sun, Yang Liu
| Challenge: | Large Language Models (LLMs) have witnessed remarkable advancements in recent years, prompting the exploration of tool learning. |
| Approach: | They propose a virtual API server and stable evaluation system to assess the stability of large-scale real-time APIs. |
| Outcome: | The proposed benchmarks demonstrate the stability of the proposed system and its caching system. |
LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback (2025.findings-acl)
Copied to clipboard
Thai Quoc Hoang, Kung-Hsiang Huang, Shirley Kokane, Jianguo Zhang, Zuxin Liu, Ming Zhu, Jake Grigsby, Tian Lan, Michael S Ryoo, Chien-Sheng Wu, Shelby Heinecke, Huan Wang, Silvio Savarese, Caiming Xiong, Juan Carlos Niebles
| Challenge: | Large Action Models (LAMs) face challenges due to the need for high-quality training data, especially for multi-steps tasks that involve planning, executing tool calls, and responding to feedback. |
| Approach: | They propose a framework for online exploration of agentic tasks with high-quality feedback . they use a dynamic task query generator and an extensive collection of tools to create a high-level feedback environment for LLM Agents. |
| Outcome: | The proposed framework achieves 49.3% performance improvement over baselines on toolbench and CRMArena. |