Carlos Garrido-Munoz

Handwritten Text Recognition Lives in the High-Pixel Variance Subspace

In self-supervised pretraining for Handwritten Text Recognition (HTR), pixel reconstruction methods outperform contrastive methods, unlike in natural-image classification. We argue that this difference follows from where discriminative signal lies in pixel space: for HTR, it is concentrated in high-variance directions...