Natural-language style descriptions provide an interpretable interface between large language models (LLMs) and controllable text-to-speech (TTS). However, using descriptions as pseudo-labels compresses target acoustics into text, and descriptive fidelity need not imply effective control of a particular synthesizer. We...
Shi-Yue Zhu, Lian-Bo Liu, Sizhen Lyu et al.· 0 citations
Ruby-ASR is presented, which refines the conventional target into a span-bound orthographic--lexical-reading sequence and shows that refining the recognition target can improve lexical-reading recovery without sacrificing readable orthographic transcription.
Hao Shi, Yun Liu, Xue-Hao Yang et al.· 0 citations
This work proposes Hikari, a policy-free, end-to-end model for simultaneous speech-to-text translation and streaming transcription, and presents a supervised fine-tuning strategy that trains the model to recover from delays, significantly improving the quality-latency trade-off.
Roman Koshkin, Haesung Jeon, Lian-Bo Liu et al.· arXiv.org· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.