From Sim to 6DOF: Deep Learning for Real-Time Satellite Pose Estimation from Resolved Ground-Based Imagery

Abstract

This work presents the first complete system for automated six degrees of freedom (6DOF) satellite pose estimation from spatially resolved, ground-based, adaptive optics (AO)-corrected imagery, addressing a key challenge in Space Domain Awareness (SDA). The approach mitigates the need for human labeling by directly regressing satellite orientation and position from blurry, noisy, and deeply shadowed imagery. A multi-stage deep neural network pipeline localizes the satellite, predicts pose, and optionally applies temporal filtering. Networks are trained exclusively on fully synthetic imagery generated from a CAD model, yet generalize effectively to real data, bridging the Sim2Real domain gap. On 137 real, human-labeled test images of Seasat, the model achieved a mean rotation error of 5° and a mean image-plane translation error of 21 cm. Slant range error was quantitatively evaluated on synthetic data due to unknown real-sensor parameters. Qualitative evaluation of additional real Seasat imagery rated 177 of 199 predicted poses as “ground truth equivalent” or “high-confidence match,” with zero catastrophic failures. The system was extended to seven degrees of freedom (7DOF) for satellites with articulating components and demonstrated on real Hubble Space Telescope (HST) imagery, achieving 5.5° rotation error, 51 cm image-plane translation error, and 8° symmetry-adjusted solar array error on a 249-frame pass with causal temporal filtering. Across 586 real test images from Seasat and HST (captured over multiple decades under diverse conditions) the system consistently performed well. Full 6DOF performance was quantified on a high-fidelity wave optics (HFWO) synthetic test set of Seasat, where the model achieved 8.4° mean rotation error, 34 cm image-plane translation error, and 1.4% line-of-sight range error at r0=6 cm and 1031 km range. In a limited 200-image benchmark, the model demonstrated 48% lower mean rotation error than a single human labeler while operating ∼800× faster. It required <40 h and a single A100 GPU to generate data and train. The approach was also demonstrated for ARGOS, a smaller satellite with highly symmetric geometry. An exploratory General Image-Quality Equation-based image quality metric (AO-IQ) was introduced as an empirical correlate for pose accuracy. General-purpose models like GPT-4o and Depth Anything V2 failed across most SDA tasks, but rapid gains in vision-language models warrant continued monitoring. These results establish a new operational baseline for practical, real-time satellite pose estimation from AO SDA imagery.