Are Online Skill and Memory Modules Always Worth Their Tokens? A Budget-Constrained Study of Web Agents
The results suggest that skills and workflow memory can be useful in specific domains, but their apparent gains often vanish against a budget-matched actor, and that run-to-run variance materially affects outcomes and should be reported as a core evaluation criterion for online web agents.