NaviDC-OCR introduces deformation-aware learning to incorporate geometric perception into VLMs and proposes an adaptive sampling mechanism for complex layout representation, and a content-structure decoupled learning strategy is developed to explicitly model formula grammars and table structures, enabling more effectiv...
Peng Cai, Zhaofan Zou, Shifa Liu et al.· 0 citations
DataOrchestra, a framework that unifies different processing operations and orchestrates an example-specific pipeline for each example, is proposed and effective for math continued pretraining and outperforms stronger processing baselines, while reducing processing compute by skipping unnecessary downstream operations.
Zhen Huang, Yikun Wang, Shijie Xia et al.· 0 citations
Through a systematic study of four flagship models, a previously overlooked phenomenon is identified: under extensive context, models give up or provide uncertain incorrect answers long before exhausting the context window.