Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 10693-10703· 0 citations· 57 references
TL;DR
This work proposes a multi-modal Joint-Embedding Predictive Architecture for PPG and ECG and shows that the model learns robust cross-modal alignment without relying on contrastive learning, and demonstrates that performance remains robust even with lower-quality signals.
Abstract
Foundation models for physiological signals have shown promise for health monitoring, with recent work exploring multi-modal approaches that leverage complementary information across modalities such as PPG and ECG. However, existing methods typically rely on contrastive objectives or reconstruction losses that operate in the input space, making them susceptible to sensor noise inherent in physiological recordings. We propose a multi-modal Joint-Embedding Predictive Architecture for PPG and ECG. Building on LeJEPA's theoretically grounded framework, our approach performs predictions entirely in a unified latent space, avoiding the need to model input-level noise. Separate encoders map each modality to a shared embedding space regularized toward an isotropic Gaussian -- a distribution provably optimal for downstream task performance. Stochastic modality dropout during training ensures each encoder learns complete representations, enabling inference and downstream fine-tuning with only a single modality despite training on paired PPG-ECG data. This flexibility is critical for real-world deployment where ECG is unavailable but its richer cardiac information can still inform PPG representations learned during pretraining. We evaluate our approach on a wide range of PPG downstream physiological assessment tasks, such as heart rate estimation, atrial fibrillation detection, and blood pressure estimation, demonstrating substantial improvements over existing baselines. Furthermore, we show that the model learns robust cross-modal alignment without relying on contrastive learning. Finally, we demonstrate that performance remains robust even with lower-quality signals, a common scenario for real-world PPG recordings.
Heterogeneous cardiac signals can mutually supervise a single foundation model of cardiac physiology using a physiology-aware joint-embedding predictive architecture built on a physiology-aware joint-embedding predictive architecture.
Hamza Shafiq, Hung Manh Pham, Bin Zhu et al.· 3 citations· ⚡1
A hybrid architecture that jointly learns unimodal and cross-modal representations via uncertainty-weighted multi-task learning while utilizing an LLM-based pipeline to extract high-fidelity findings from cardiologist reports is proposed.
L. Y. Panchumarthi, Andrew Lu, Saurabh Kataria et al.· 0 citations
TRACE is proposed, a Tractable Routing Autoencoder for Clinical ECG, whose 32-dimensional clinical latent space is specified in advance from domain knowledge rather than discovered by optimization, and reconstructs the ECG through a decoder that permits latent perturbation.
Shun-Bo Jia, Run-Ze Ma, Haonan Lyu et al.· 0 citations
Electrocardiogram (ECG) signals are essential for arrhythmia diagnosis. With the growing adoption of long-term monitoring via wearable and portable devices, energy-efficient acquisition has become critical, motivating the development of ECG super-resolution (SR) techniques to reconstruct high-resolution signals from lo...
Fan-Yi Hsu, I. Chiu, Kuan-Chen Wang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.