This work introduces SciDocBench, a workflow-centered benchmark targeting capability diagnosis with verifiable training-data construction for scientific-document assistants, and SciDocIR, a structured representation of scientific document objects, layout and cross-reference relations, and provenance.
Shenxi Wu, Yu-Hong Liu, Hao-Song Zhang et al.· 0 citations
Pinocchio is introduced, an external calibrator that estimates the correctness of responses from black-box API models that needs only a single forward pass to generate an uncertainty estimate and requires no access to the target model's logits, weights, or internal states.
K. D. Hayes, Arka Pal, Hao-Song Zhang et al.· 0 citations
Scientific papers require models to reason jointly over text, equations, figures, tables, code, and datasets while preserving the provenance of supporting evidence. Existing benchmarks typically evaluate these capabilities in isolation, leaving unclear whether multimodal models can support realistic scientific-reading...
Shenxi Wu, Yu-Hong Liu, Hao-Song Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
