Skip to content

mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers

Aug 2026 · 1 citation · 73 references
Computer Science

TL;DR

The evidence supports mimeo as a compact, inspectable reference on a person, not as a demonstrated transfer of their judgment; the evidence supports mimeo as a compact, inspectable reference on a person.

Abstract

Giving an agent a file about a named expert can supply hard-to-find material, produce a recognizable persona, or change what the agent decides. These are different claims. We test each one. mimeo is an open-source tool that finds a person's public work, checks each extracted quotation against the cached source text, and writes a file an agent can load. Eight logged builds averaged 38 model calls; the check rejects 13.2% of extracted quotations. We tested four expert files with one coding-agent harness. Knowledge access was clearest: mimeo answered all 20 obscure, quotation-heavy questions; no closed-book condition answered more than 10. Keyword search (BM25) over the same pages answered 15-17, a gap this sample cannot resolve. Grounding showed one clear benefit: personas written from model memory misstated a documented position on 1-4 of 20 answers under every grader; the plain agent and mimeo never did. Every persona was easy to spot on short open prompts, and adding task material lowered identification by 18-23 points. mimeo was no more identifiable than a from-memory profile. Judgment transfer remained unresolved because both tests hit their ceiling: every condition found 94-97% of the problems planted in engineering tasks and scored 94-100% on 16 new application scenarios. An AI-judged"sounds like the expert"score changed with the judge: two of four preferred answers based on a model's stereotype, while two found no difference on the same text. That is a caution against relying on a single AI judge. The evidence supports mimeo as a compact, inspectable reference on a person, not as a demonstrated transfer of their judgment. Toolkit and expert profiles: https://github.com/K-Dense-AI/mimeo

View source

Similar papers

#artificial intelligence Preprint Sep 2026

Skill Issue: Lessons from Optimizing Repository SKILLs for Coding Agents

This work mine harder tasks --- merged pull requests of the repository, reverted at a single frozen base commit; and score a candidate document by whether the same agent does better with it than without it, to find a maintainer of one repository found in them knowledge one only gets by working in the project.

M. Kozyrev, A. Kozyrev, A. Podkopaev · 3 citations · ⚡1
#artificial intelligence Review Sep 2026

CART: Closed-Loop Adaptive Red Teaming for Large Language Models

CART turns red teaming from a one-time checklist into a continuous, adaptive, and auditable search for model and agent weaknesses, suggesting that contextual adaptation can reveal weaknesses that direct prompt replay does not exercise.

Dong-Dong Zhang, Teng-Chao Lv, Yi-Ling Jia et al. · 0 citations
Preprint Aug 2026

GitSkills: A Dataset of Agent Skills on GitHub

GitSkills is presented, a dataset of 3,797,117 $\mathrm{SKILL.md}$ files collected from 282,200 public repositories in July 2026, which retains every file occurrence with its repository, path, and content hash.

Giuseppe Destefanis, Daniel Graziotin, Matteo Vaccargiu et al. · 1 citation
Preprint Jul 2026

SIGIL: Compiling Agent Skills into Typed Harnesses

Skill Compilation is introduced, realized in SIGIL, which compiles a prose skill into an executable harness, and is model-independent: the harness holds at 86% across two model generations while prose swings from 56% to 68%.

Jayanaka L. Dantanarayana, Savini Kashmira, Lingjia Tang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.