DNFormer: Differential Attention for Graph Transformers
DNFormer mitigates structural dominance in attention aggregation, better capturing node-specific relational patterns while preserving local structural properties, and introduces a differential local attention mechanism in DNFormer that computes attention scores as differences across multiple topology-aware similarity m...