Challenge: Existing retrieval methods rely on static inputs, failing to capture multi-step tool dependencies and evolving task context.
Approach: They propose a lightweight retrieval method that conditions on initial query and evolving task context.
Outcome: The proposed method improves function calling success rates between 23% and 104% compared to state-of-the-art retrieval methods.

Similar Papers

ToolDreamer: Instilling LLM Reasoning Into Tool Retrievers (2026.eacl-long)

Copied to clipboard

Challenge: Existing retrieval models rank tools based on similarity between query and tool description (TD) Existing tools are not conditioned to learn tool-to-tool relationships (middle).
Approach: They propose a framework that conditions retrieval models to fetch tools based on hypothetical (synthetic) TD generated using an LLM.
Outcome: The proposed framework improves the performance of sparse and dense retrievers with and without training, showcasing its flexibility.
Retrieval Models Aren’t Tool-Savvy: Benchmarking Tool Retrieval for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) suffer from inherent inabilities to interact with the physical world and access vast, up-to-date knowledge.
Approach: They propose a tool retrieval benchmark for large language models (LLMs) that includes 7.6k diverse retrieval tasks and a corpus of 43k tools.
Outcome: The proposed model performs poorly on the heterogeneous tool retrieval benchmark, resulting in low pass rate and low retrieval quality.
Planning and Editing What You Retrieve for Enhanced Tool Learning (2024.findings-naacl)

Copied to clipboard

Challenge: Existing methods for integrating external tools with Large Language Models fall short on effectively shortlisting relevant tools.
Approach: They propose a plan-and-retrieve and edit-and ground paradigms for LLMs that decompose complex queries into actionable tasks.
Outcome: The proposed paradigms significantly improve recall and NDCG in tool retrieval tasks, surpassing current state-of-the-art models.
Beyond Single-Shot: Multi-step Tool Retrieval via Query Planning (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) are evolving from text generation into integration within agentic workflows . tools such as APIs, databases, and software tools are expanding rapidly .
Approach: They propose a lightweight framework that models retrieval as iterative query planning . instead of single-shot matching, ToolQP decomposes instructions into sub-tasks .
Outcome: The proposed framework achieves state-of-the-art performance and robustness across retrievers.
Enhancing Tool Retrieval with Iterative Feedback from Large Language Models (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing methods have shown that large language models can handle a certain amount of tools through in-context learning or fine-tuning.
Approach: They propose to enhance tool retrieval with iterative feedback from the large language model by prompting the tool usage model to provide feedback for the tool retriever model in multi-round.
Outcome: The proposed approach achieves advanced performance in both in-domain evaluation and out-of-domain assessment.
How Can Input Reformulation Improve Tool Usage Accuracy in a Complex Dynamic Environment? A Study on tau-bench (2025.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in reasoning and planning capabilities of large language models have enabled their potential as autonomous agents capable of tool use in dynamic environments.
Approach: They propose an input-reformulation multi-agent framework that reformulates user queries .
Outcome: The proposed framework outperforms ReAct, Function Calling, and Self-Reflection in overall pass5 scores.
GEAR: Augmenting Language Models with Generalizable and Efficient Tool Resolution (2024.eacl-long)

Copied to clipboard

Challenge: Recent work on Augmented Language Models (LLMs) over-rely on task-specific demonstrations that limits their generalizability and computational cost.
Approach: They propose a query-tool grounding algorithm that is generalizable to various tasks . they delegate tool grounding and execution to small language models and LLMs .
Outcome: The proposed algorithm outperforms baselines on 14 datasets and shows it can be generalized to different tasks.
Improving Tool Retrieval by Leveraging Large Language Models for Query Generation (2025.coling-industry)

Copied to clipboard

Challenge: Large Language Models (LLMs) have shown great promise in common sense language understanding, conversational fluency, and reasoning.
Approach: They propose to use Large Language Models to generate a retrieval query and embed it into the prompt to find relevant tools via a nearest-neighbor search.
Outcome: The proposed method improves retrieval for in-domain (seen tools) and out-of-domain settings.
ToolScope: Enhancing LLM Agent Tool Use through Tool Merging and Context-Aware Filtering (2026.acl-long)

Copied to clipboard

Challenge: Large language model (LLM) agents often face strict input context limits, preventing efficient consideration of large toolsets.
Approach: They propose a tool that allows LLMs to merge tools with auto-correction and toolScopeRetriever to rank and select only the most relevant tools for each query.
Outcome: Evaluations on three state-of-the-art LLMs and three open-source tool-use benchmarks show gains of 8.38% to 38.6% in tool selection accuracy.
Meta-Tool: Unleash Open-World Function Calling Capabilities of General-Purpose Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Large language models struggle with addressing diverse user inquiries in open-world tasks.
Approach: They propose a plug-and-play tool retrieval system for LLMs to access external tool library and use retrieved tools to solve user's problem.
Outcome: The proposed model improves on a finetuned version of LLaMA-3.1 and 2,800 dialogues and 7,361 tools spanning ten distinct test categories.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations