ChipMEM, a verification-grounded memory layer for EDA agents, is introduced, a verification-grounded memory layer for EDA agents that combines cross-task procedural memory with within-trajectory statistical guidance.
Abstract
Large language model (LLM)-based agents use Electronic Design Automation (EDA) tools to generate and revise register-transfer-level (RTL) designs under synthesis and verification feedback. Recent methods learn from this feedback by distilling reusable skills from execution traces or by training on rewards derived from EDA-tools. Both methods are typically evaluated on the tasks that produced the experience. Repeated access to benchmark feedback on the same task can reward task-specific revision rather than creating reusable knowledge that transfers. We introduce ChipMEM, a verification-grounded memory layer for EDA agents. It combines cross-task procedural memory with within-trajectory statistical guidance. Its procedural component distills and stores a skill only after it passes synthesis, simulation, or formal checks, rather than relying on model self-assessments. A Bayesian component maintains hierarchical Beta estimates over tool-call outcomes and ranks recovery strategies that succeeded under comparable errors. A common adapter applies the same memory interface to RTL optimization and testbench-generation agents while preserving each domain's tools and acceptance criteria. We measure performance on training tasks and evaluate whether learned skills transfer to unseen tasks. On RTLRewriter-Bench, under matched model and tool settings, ChipMEM produces equivalence-passing outputs on 39/54 scored designs versus 35/54 without memory; on the 49-design short suite, mean area improvement is 8.69% versus 5.66%. On held-out CVDP tasks, ChipMEM with a frozen procedural library achieves 20/20 accepted outcomes versus 18/20 without memory in a single evaluation per setting.
LLM-based penetration-testing agents execute multi-step security tasks through tool use and environment feedback, but flat interaction histories can become noisy, unstructured, and difficult to reuse in subsequent decisions. To address this problem, we propose MAM-PT, a memory-augmented middleware that organizes agent...
Wei-Hao Sun, Wen-Hao Wang, Wan-Li Wu et al.· 2026 6th International Confe...· 0 citations
V Vestrum, a framework that turns failures in execution traces into scoped harness changes without training the task model, is introduced, a framework that turns failures in execution traces into scoped harness changes without training the task model.
Jayant Parashar, Eugene F. Douglass, William C. Bastian et al.· 0 citations
TicTacBench is proposed, a benchmark specifically designed to evaluate coding agents' capabilities for RTL-level timing closure under post-place-and-route (post-PnR) evaluation, and TicTacSkill is proposed, a new method that guides agents to follow standard timing-closure procedures and improves the Timing Closure Rate...
Bo-Wei Wang, Zhigang Fang, Zhijie Yang et al.· 0 citations
Recently, the rapid development of large language models (LLMs) has reshaped software engineering by enabling autonomous code agents that plan, execute, and utilize external tools iteratively to tackle complex tasks. Beyond achieving functional correctness, these agents must faithfully follow process instructions and c...
Bo-Si Wen, Cun-Xiang Wang, Jia-Yi Gui et al.· 0 citations
In this work, HLS-Eval is extended with an agentic evaluation flow built on the open-source mini-swe-agent framework, which establishes a foundation for agentic HLS design and motivates harder benchmarks and new agentic tooling as model capabilities progress.
Language-model agents increasingly rely on harnesses that manage bounded context, persistent memory, tools, verification, and repeated execution, yet existing notions of model capability do not quantify the computational resources these mechanisms consume. We introduce the Language Model Agent Machine (LAM), a resource...
Ze-Lin Zhao, Xin-Yu Guo, Jing-Yuan Zhang et al.· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduAug 27, 2026
A new machine-learning framework aims to improve the success rate of computational protein design while moving away from results that reproduce sequences found in nature.