A novel optimizer-corrector framework that alternates between gradient steps for objective minimization and guided flow matching to drive the latent state back to the valid shape manifold is introduced, preserving geometric validity without sacrificing expressiveness while remaining computationally feasible on modern 3D shape models.
Abstract
Optimizing 3D shapes within the latent spaces of deep generative models is fundamental to computer assisted engineering, yet remains prone to a critical failure mode we term manifold drift: the tendency of gradient-based optimization to move latent vectors away from the manifold of valid shapes. This problem is exacerbated in state-of-the-art 3D shape generative models that operate in increasingly high-dimensional latent spaces where valid shapes occupy a vanishingly small fraction of the full space. Existing mitigation strategies, including latent regularization and flow-matching approaches, either sacrifice expressiveness, demand a difficult trade-off between objective guidance and generative fidelity that remains prone to manifold drift, or are computationally infeasible to scale to modern, large-capacity 3D shape models. We introduce a novel optimizer-corrector framework that alternates between gradient steps for objective minimization and guided flow matching to drive the latent state back to the valid shape manifold. By decoupling objective minimization from flow-based correction, optimizing freely and correcting strictly, this alternating design avoids inherent trade-offs, preserving geometric validity without sacrificing expressiveness while remaining computationally feasible on modern 3D shape models. We demonstrate its effectiveness across generative priors of varying complexity, from simple vector latent spaces to large-scale architectures across a variety of downstream optimization tasks, including aerodynamic drag reduction and object compliance optimization.
Geometrically parametrised PDEs arise in shape optimisation, where solving a PDE over many deformed domains at manageable cost is a central challenge. Free-form Deformation (FFD) parametrises shape variations through a lattice of control points, but the resulting parameter space is typically high-dimensional, with most...
G. Padula, C. Giovannini, G. Rozza et al.· 0 citations
Transferring deformation between characters with different geometry and topology is challenging because conventional rigs encode behaviour through character-specific structures and correspondences. We present LatentReRig, an experimental framework that investigates whether pose-associated changes can instead be represe...
D. Dolci, Fabrizio Poggioni, Carlo Melchiorri· 0 citations
Engineering design often starts from a 2D sketch that fixes style and proportions, yet the subsequent 3D shape optimization relies on learned generative priors to keep the geometry valid. However, these priors are agnostic to the sketch: while they admit a valid design by correcting a drifted proposal back to its train...
Han-Tao Zhang, Oliver Heinimann, Jie Wu et al.· 0 citations
This work introduces manifold-stable flow matching (MSFM), which can start from an arbitrary ambient prior, not necessarily supported on the manifold, and guarantees manifold invariance and transverse convergence to the manifold within a desired time window.
Amirhossein Nazerian, A. Pezeshki, Jian-Guo Zhao· 0 citations
Preference optimization is a standard alignment method for generative models, yet extending it to continuous-time dynamics remains non-trivial. In flow matching, reward-driven updates modify transport trajectories without an inherent constraint to the pretrained data manifold and can move terminal samples off the pretr...
Yan-Sen Han, Shengyi Liao, Yuan-Xing Zhang et al.· 0 citations
Recent advances in distillation and flow-map models have enabled deterministic one- or few-step generation for high-quality data, facilitating a new branch of reward alignment approaches that directly optimize the initial noise from a Gaussian distribution. However, most existing initial-noise optimization methods rely...
Jin-Ho Chang, Jong Chul Ye· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.