The results point towards the potential feasibility of writer adaptation for the HMER task through a writer-adaptive fine-tuning pipeline to MFH-CoMER, with the model struggling for handwriting articles that the base model can already evaluate well.
Abstract
Handwritten mathematical expression recognition (HMER) refers to the task of recognizing and converting handwritten mathematics into a parsable markup language, usually LaTeX. No current state-of-the-art-competitive system adjusts to the way a specific person writes, and the domain gap between training images (usually digital or perfectly binarized) and images physically taken with a camera used in inference has received fairly little attention for this specific problem. We characterize this domain gap through fragmentation and stroke-width analyses of the images as well as introduce a writer-adaptive fine-tuning pipeline to MFH-CoMER in an attempt to address it. We further introduce sample author-specific datasets, consisting of five handwriting category subsets from two authors, and evaluate using a McNemar's test and permutation tests adapted to limited data. Results suggest an increase in expression recognition rate and a decrease in CER for digital handwriting but more varied results for physical handwriting, with the model struggling for handwriting articles that the base model can already evaluate well. Nonetheless, adapted models were found to have improved results for four out of five subsets. Statistical testing results suggest a consistency in improvement for two of the tested author-specific subsets. Our results point towards the potential feasibility of writer adaptation for the HMER task.
Handwritten Text Recognition (HTR) systems have become an indispensable tool for the digitization of historical documents. Not only do they cut down time and cost, but they also allow democratizing access and processing of their contents by generating their transcripts. However, literature in HTR currently focuses most...
Eric Ayllon, Abel Gandia, Jorge Calvo-Zaragoza· arXiv.org· 0 citations
Offline handwritten text recognition (HTR) remains one of the most challenging problems in document image analysis because of the enormous variability of individual handwriting styles, inconsistent stroke widths, irregular slant and the scarcity of large annotated corpora. Data augmentation has become the de-facto stra...
Lalita Kumari· International journal on eme...· 0 citations
The results show that the value of pixel reconstruction depends on where discriminative signal lies in the input, which predicts that objectives preserving high-variance pixel content will transfer best.
Carlos Garrido-Munoz, Jorge Calvo-Zaragoza· 0 citations
The proposed model is a 2-channel CNNs model with multiple spatial-attention convolutional layers that operates at the character level, enabling finer-grained analysis with reduced sensitivity to spacing and alignment variations.
Li Zhu, Long Tang, Hua-Qing Mao· PLoS ONE· 0 citations
Experiments on seven heterogeneous handwriting benchmarks show that complementary supervision consistently improves training with page transcription alone, while joint multi-source training provides further gains on most datasets, and the proposed sparse expert model further improves the dense baseline on six of the se...
Nam Hoai Dang, H. Nguyen, Quang Huu Hieu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.