A Conditional Speaker Normalization module is introduced that conditions the normalization process on speaker embeddings derived from either speaker verification systems or a speaker-height estimation model to mitigate the speaker-dependent nature of Log-Area Ratios.
Abstract
The rapid advancement of text-to-speech and voice conversion technologies has significantly improved the quality of synthetic speech, posing increasing challenges for developing reliable detection countermeasures. This study proposes a synthetic speech detection approach based on Log-Area Ratios (LARs) as acoustic features that provide a direct representation of vocal-tract shape. The underlying premise is that synthetic speech may exhibit inconsistencies in the speech production process that manifest as unnatural vocal-tract configurations, which can be captured through LAR features. To mitigate the speaker-dependent nature of LARs, we introduce a Conditional Speaker Normalization module that conditions the normalization process on speaker embeddings derived from either speaker verification systems or a speaker-height estimation model. These embeddings are processed through a set of fully connected layers to generate a bounded scaling vector that modulates the LAR features, improving their robustness and discriminative power in the evaluated setting. Experimental results show that the proposed approach improves performance on the FoR and Logical Access protocol of ASVspoof 2019 datasets, particularly with the speaker-height-related conditioning representation. Phoneme-level Integrated Gradients analysis indicates higher relative attribution to specific articulation categories, especially vowels. These patterns are consistent with a possible reduction in speaker-dependent articulatory variability, although the results do not establish that anatomical height information alone causes the improvement.
Real-time voice conversion (VC) systems commonly rely on pretrained speaker embeddings from automatic speaker verification (ASV) models. While effective for speaker discrimination, these embeddings are trained to remain stable across phonetic and prosodic variations within-speaker, which may conflict with frame-level a...
Mu-Ruei Tseng, Waris Quamer, Ghady Nasrallah et al.· 0 citations
Target Speaker Extraction (TSE) is pivotal in speech communication and human-computer interaction, enabling the isolation of a specific speaker's voice from complex acoustic environments, i.e., the cocktail party scenario. Although traditional TSE systems conditioned on enrollment speech have progressed substantially,...
Xin-Yuan Qian, Yang Zhou, Zi-Yang Jiang et al.· 0 citations
The transition from vocoder-based to neural-codec speech synthesis makes generalization more difficult for speech deepfake detectors, particularly those relying on speech-oriented representations. It remains unclear which acoustic representations retain discriminative information when the generation mechanism changes....
Target-speaker and multi-speaker extraction are techniques for extracting speech from a desired speaker or desired speakers in the presence of other speakers and/or noise. Neural network approaches for this task are often trained and evaluated using simulated datasets, with balanced amounts of target speech and speaker...
Robert Sutherland, Stefan Goetze, Jon Barker· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.