Sheng-Feng He

MODdapter: Spatially-aware text embeddings for zero-shot semantic segmentation.

Vision-language models show promise in zero-shot semantic segmentation, but a key challenge is the disconnect between text and visual features. While text embeddings can roughly localize unseen objects, they often lack the fine-grained detail necessary for accurate segmentation, leading to oversegmentation or undersegm...