Papers with SafeToolBench
SafeToolBench: Pioneering a Prospective Benchmark to Evaluating Tool Utilization Safety in LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing approaches fail to fully capture all risks in tool utilization, resulting in financial loss or privacy leaking. |
| Approach: | They propose a framework to assess the safety of LLM tool utilization in a prospective manner, covering malicious user instructions and diverse practical toolsets. |
| Outcome: | The proposed framework significantly enhances LLMs’ self-awareness, enabling a more safer and trustworthy tool utilization. |