Cross-modal alignment with language tokens for unified multilingual image-to-text generation
Current multimodal translation systems typically employ a cascaded pipeline where image captioning and machine translation are performed sequentially, leading to error propagation and semantic drift. This paper introduces a unified neural architecture that integrates visual encoding, English caption generation and mult...