#artificial intelligence
Jun 2026
ToolSense: A Diagnostic Framework for Auditing Parametric Tool Knowledge in LLMs
This work introduces ToolSense, an open-source LLM-powered diagnostic framework that takes any tool catalog as input and automatically generates three benchmarks: a Realistic Retrieval Benchmark (RRB) with queries at three ambiguity tiers, an MCQ probing benchmark, and a QA probing benchmark.
Ashutosh Hathidara, Sai Shruthi Sistla, Sebastian Schreiber et al.
· arXiv.org · 2 citations