P.R.Sheebha Rani

A Robust Image–Text Alignment Framework using BLIP-2, CLIP and Caption Guided Fusion

Vision-language models have made remarkable improvements in multimodal understanding still, correctly mapping an image with its respective text is still problematic. A caption-based multimodal fusion scheme that fuses Bootstrapping Language-Image Pre-training Version 2(BLIP-2) and Contrastive Language–Image Pre-trainin...