Technology

SCMerge: Spatial-Consistency-Aware Token Pair Merging for Efficient Semantic Segmentation

Vision Transformer architectures have showcased impressive performance on semantic segmentation, yet their quadratic attention complexity hinders practical applications. Recent works have focused on merging tokens to reduce sequence length and thus improve transformer efficiency. However, existing token merging methods...