Skip to content

Enabling Creative Exploration for Vibe Design Agents

Sep 2026 · 0 citations · 44 references
Computer Science

TL;DR

This work identifies structured design specifications as a practical control point for exploring alternative UI concepts while keeping downstream generation settings fixed through an inference architecture that makes design direction an explicit intermediate decision.

Abstract

Vibe design agents turn natural-language briefs into rendered interfaces and frontend code. Yet a useful design agent should do more than produce one valid page: it should help users explore coherent alternatives. Increasing token-level temperature is a blunt solution because it varies aesthetic decisions and syntax-sensitive code at the same time. We instead separate exploration from implementation through an inference architecture that makes design direction an explicit intermediate decision. Inspired by Verbalized Sampling, a pre-pass proposes structured design specifications with typicality scores, an external selector samples one, and the downstream generator realizes the selected specification together with the original request under fixed settings. We apply this approach to UI themes and visual-asset prompts. Across 168 prompts, with 1,255 paired comparisons per temperature for each intervention, theme sampling broadens observed selection coverage and screenshot variation, while LLM-judge preferences vary across interventions, prompt complexity, and viewport. In an online experiment with more than 300,000 tasks, the observed code-export increase remains statistically uncertain, while fewer negative feedback events coexist with more correction interactions and modest operational costs. Together, these findings identify structured design specifications as a practical control point for exploring alternative UI concepts while keeping downstream generation settings fixed.

View source

Similar papers

#human-computer interacti... Preprint Aug 2026

FocusGen: Expanding Visual Design Exploration with a Simulated Focus Group of Persona Agents

FocusGen is presented, an interactive system that introduces external perspectives into visual design exploration through a "virtual focus group" of simulated persona agents, and is positioned as a divergence scaffold for early-stage ideation rather than a substitute for audience research.

Jaewon Choi, H. Vasconcelos, H. Lee et al. · 1 citation · ⚡1
#artificial intelligence Preprint Sep 2026

Engineering Simplicity: Simple Mechanism Interfaces Steer LLM Agents

The findings suggest that human-motivated theories of simplicity can inform the design of decision environments for artificial agents and show why scaffolds should be evaluated through realized choices as well as explanations: improvements in one need not appear in the other.

Ke-Hang Zhu, Anand Shah, David C. Parkes · 0 citations

A Typography Benchmark for Co-Creative Graphic-Design Agents

A typography-focused benchmark of 12 tasks grounded in a layered-composition corpus of 989 real-world design templates and 2,568 text elements is introduced to quantify how well future design partners can perceive, reproduce, and manipulate the ty-pographic layer designers care about most.

Jaejung Seol, Elad Hirsch, Hao-Nan Zhu et al. · 0 citations
Preprint Aug 2026

AutoDesign: Meta-Harness Optimization for Long-Horizon Agentic Design

Transforming multimodal sources into condensed and structured media outputs can be fundamentally conceptualized as a long-horizon agentic process centered on a model-harness system. While an ideal harness system should align with human design priors and accumulate reusable experience through empirical exploration to dr...

Yaxin Luo, Hao-Bin Jiang, Jialv Zou et al. · 6 citations
Review Aug 2026

Agentic Artifact Creation: Systems, Evaluation, Principles, and Opportunities

This survey examines agentic artifact creation, which is defined as stateful construction in which an AI system materially constructs or revises a deliverable and intermediate observations redirect later work, and formulate principles for keeping commitments and responsibility explicit, turning feedback into targeted r...

Tianfu Wang, Zhezheng Hao, Xinchi Xia et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Sep 29, 2026

Who we become when we talk to machines

Professor Sherry Turkle’s new book, “Artificial Intimacy,” offers a withering critique of chatbots and the antisocial dynamics she believes they encourage.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.