Cross-Resolution Knowledge Distillation for Low-Compute Fine-Grained Bird Classification
The results support cross-resolution KD as a practical way to recover fine-grained information during training while preserving low-resolution inference cost and show that a stronger teacher does not automatically produce a stronger student: transfer quality depends on the balance between teacher supervision strength a...