Kronecker-preconditioned optimizers recompute a cached curvature eigendecomposition only periodically, and implementations and adaptive methods control this through the refresh frequency. We show that frequency leaves part of a schedule free: at a fixed number of refreshes, when they occur changes held-out loss at the...
Xin-Yu Wang, Zhi-Wei Zhai, Yu Gu et al.· 0 citations
This study provides a compact and scalable semantic foundation for large-scale information processing and evidence mapping in water treatment research by developing WaterBERT, a domain-adapted encoder model designed for semantic representation and structured information extraction from water treatment texts.
Mu-Di Zhai, Rui-Hong Qiu, Qing-Yun Zeng et al.· 0 citations
Financial question answering over U.S. Securities and Exchange Commission (SEC) filings requires retrieving and synthesizing heterogeneous evidence dispersed across long, standardized, and highly redundant disclosures. Existing retrieval-augmented and multi-agent systems typically derive retrieval queries directly from...
Jijun Chi, Zhenghan Tai, Hanwei Wu et al.· arXiv.org· 0 citations
DoGMA demonstrates that domain-specific inductive biases can improve the robustness and transferability of multi-omics foundation models, offering new insights into the design of attention mechanisms for multi-omics representation learning.
Junfei Ling, Bangzheng Pu, Bing-Sen Xue et al.· 0 citations
DocNavRAG is introduced, which organizes document hierarchies and cross-region relations into a navigable graph, exposes graph operations for locating, navigating, expanding, and fetching, and maintains an evolving evidence state to guide retrieval until sufficient evidence is collected.
Dong Xie, Yao Tian, Hao Zhang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.