ClusterAttention: A training-free speedup of bidirectional attention
ClusterAttention is the first training-free method that can be successfully applied in the setting of unstructured input and a single forward pass, and is the first training-free method that can be successfully applied in the setting of unstructured input and a single forward pass without offline calibration.