Jacob Whitehill

Transformer-Encoder Trees for Efficient Multilingual Machine Translation and Speech Translation

Transformer Encoder Tree is introduced, a hierarchical, non-autoregressive encoder-only architecture trained with Connectionist Temporal Classification for multilingual translation that eliminates the sequential bottleneck of autoregressive models and supports fully parallel decoding of all tokens across all target languages.