Constrained optimization is central to many engineering systems in which decisions must satisfy strict safety and operational requirements, especially in real-time settings with limited computational budgets. In such scenarios, optimization algorithms are often terminated before full convergence, making *anytime feasib...
Sina Sharifi, Jiarui Wang, Mahyar Fazlyab· 0 citations
Minimally Invasive Steering Vector Optimization (MISVO), which penalizes interventions using the local KL geometry of the induced token distribution, achieves the highest mean reward in six of seven model--task settings, with diversity and coherence scores close to those of Best-of-N.
Taha Entesari, Jingyu (Jack) Zhang, Daniel Khashabi et al.· 0 citations
This work proposes a chance-constrained formulation for safety-preserving fine-tuning that limits the fraction of safety examples whose degradation relative to a reference model exceeds a prescribed threshold and develops a constraint-aware gradient descent method that treats the majorized constraint as a safe set in p...
Taha Entesari, Mahyar Fazlyab· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.