Jose Manuel Carrichi Chavez

Natural language decoding from EEG via transfer learning and multimodal contrastive learning

A framework for sentence-level language decoding based on transfer learning and multimodal contrastive alignment is proposed, training an EEG encoder to align neural signals with pretrained text embeddings that are subsequently inverted into text using a pretrained embedding-to-text model.