Skip to content

Right Family, Wrong Skill: Benchmarking Risk Exposure in Agent Skill Retrieval

· 0 citations · 52 references

TL;DR

SameCapRisk-Bench is introduced, an auditable benchmark with 1,190 skill-risk units and 1,686 evaluation query cases: 694 marked-sibling units under public library pressure and 496 hard role-flip units where the same two skills swap helpful/risky roles across paired queries.

View source

Similar papers

#artificial intelligence Review Oct 2026

An Empirical Study of Agent Skills'Downstream Utility

Agent Skills package procedural guidance and resources for reuse, but a relevant Skill does not necessarily improve task performance. Existing studies characterize Skill content and evaluate downstream performance, yet provide limited explanations of how utility depends on content, execution configuration, and multi-Sk...

Yu Cheng, De-Hai Zhao, Zhong-Xin Liu et al. · 0 citations
Preprint Aug 2026

CaSKG: Counterfactual-Causal Skill Graphs for Scalable Agent Skill Retrieval

CaSKG, a counterfactual-causal skill graph framework that calibrates procedural relations before retrieval, is proposed, position edge-confidence calibration as an effective route to compact and executable skill retrieval at scale.

Zhiyuan Li, Lin-Yuan Gao, Xue-Chun Ding et al. · 3 citations
#artificial intelligence Preprint Sep 2026

SkillSeek: Revisiting Agent Skill Retrieval at Marketplace Scale

Anthropic's Agent Skills package reusable procedural know-how for an LLM agent into SKILL.md directories, and open-source aggregations have grown past 230,000 skills, making selection rather than authoring the bottleneck. The standing answer in the literature outsources selection to the agent itself: an LLM-mediated re...

Guanqun Yang, Wen-Long Zhang, Tian Shi et al. · 1 citation
Preprint Sep 2026

SkillSeam: Six Principles for Auditing Agent Skill Collections

A folder of competent skills is not yet a reliable system. Skills rarely fail alone; they fail at the seams of a collection. As an agent's skill library grows, procedures compete for attention, aliases double-load, boundaries blur, and poorly sized skills turn routing errors into task failures. We introduce SkillSeam,...

Rui-Yuan Kang · 0 citations
Review Sep 2026

Evaluating Agent Skills for Version-Specific Plugin Migration: A Retrospective Study

The study contributes a traceable evaluation that connects aggregate reward to contract-level evidence and judge sensitivity, together with concrete review checks for migration advice, together with concrete review checks for migration advice.

Bei-Ming Liu, Hai-Hao Li, Min-Jie Chen et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.