MetaEncoder: Exploring the Limit of Bi-Encoders for Multimodal System One Decision Making with Natural Language Interface
This work introduces MetaEncoder, which fine-tunes a pre-trained Muse-Glimmer 30B decoder into an instruction-following decision-making encoder, and employs a bi-encoder architecture trained via unidirectional contrastive learning for request-candidate alignment.