Skip to content

Horizon-Uniform Sensitivity and Decay of Terminal Reward Perturbations in Discrete-Time Pontryagin Systems

Jun 2026 · 0 citations · 15 references
Mathematics Computer Science

Abstract

We study local stationary solutions of finite-horizon discrete-time Pontryagin systems near a steady extremal. Suppose that the stationarity equation for the control is regular, the reduced state--costate map is hyperbolic, and the endpoint conditions satisfy a scaled transversality condition with respect to the stable and unstable subspaces. Then the linearized boundary-value problem admits an inverse whose Green estimate is uniform in the horizon. The Green kernel separates interior decay from the two reflections induced by the endpoint conditions. For $x_0=x_{\rm in}$ and $p_T=r_x(x_T,y)$, a contraction argument in a weighted norm proves existence and uniqueness in a neighborhood independent of $T$, together with uniform Lipschitz estimates and a pointwise quadratic remainder. We also derive an explicit admissible data radius and an a posteriori criterion for existence and local uniqueness near an approximate trajectory. For these graph boundary conditions, a one-sided Green estimate shows that a perturbation of the terminal reward changes the initial control and the gradient with respect to the initial state of the stationary objective by $O(e^{-\alpha_{\rm ter} T})$ for every $\alpha_{\rm ter}$ below the dichotomy rate. For linear-quadratic systems with invertible $A$, stabilizable $(A,B)$, $Q\succ0$, $R\succ0$, and a nonpositive terminal Hessian, a symplectic graph condition verifies the assumptions, and the finite-horizon Riccati matrix and initial feedback gain converge at rate $O(e^{-2\gamma T})$. Numerical experiments verify the certificates and the predicted decay rates.

View source

Similar papers

Preprint Aug 2026

Existence of Relaxed Equilibrium for Time-Inconsistent Mean Field Games: A Set-Valued Fixed Point Approach

This paper studies the existence of relaxed equilibria for finite-horizon continuous-time time-inconsistent mean field games. We work directly on the product space of relaxed feedback policies and population flows. The policy component is endowed with the stable topology of Young measures, while the population componen...

Zhen-Hua Wang, Zhou Zhou · 0 citations
Preprint Aug 2026

Horizon-Independent Contraction for Continuous-Time Discounted Regularized Mean-Field Games

We study contraction properties of non-stationary continuous-time mean-field games (MFGs) under discounting and entropy regularization. The state of the representative agent evolves according to a controlled continuous-time Markov chain, and both the state and action spaces are finite. In contrast to the undiscounted c...

Jun-Ji Yan, U. Aydın, T. Başar · 0 citations
Preprint Aug 2026

Stability of Differential Stochastic Variational Inequalities with History-Dependent Responses and Transfer Learning

A class of differential stochastic variational inequalities (DSVIs), in which an ordinary differential equation (ODE) is coupled with history-dependent stochastic variational inequalities (SVI), is proposed and studied, which provides theoretical and computational support for efficient transfer learning in history-depe...

Xiaojun Chen, Jian Guo, Xin Guo et al. · 0 citations
Preprint Aug 2026

Monotone Inclusion Approach to Weakly Monotone Discrete-Time Finite-Horizon Mean-Field Games

We revisit the problem of computing mean-field equilibria (MFEs) in discrete-time, monotone, finite-horizon mean-field games (MFGs). We show that, when the transition kernel is independent of the state-measure term and the reward function satisfies the usual weak monotonicity condition and is Lipschitz continuous, anch...

U. Aydın, T. Başar, Naci Saldi · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.