Context-Aware Interleaved Batching for WhisperX
By using VAD-derived segment boundaries, the algorithm stabilizes Whisper's text conditioning, allowing us to safely maintain continuous historical context across batched audio segments, all while maintaining high-throughput inference speeds.
Carlos Bain, Max Bain
· 0 citations