Skip to content

Author

Hong-Xia Yang

We have 5 of 15 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

FusionEval: Benchmarking Model Fusion for Large Language Models

Model fusion aims to integrate the capabilities of multi-expert models into a single model. Existing evaluations offer limited coverage of reasoning with long chains of thought and tool use, while strong average performance can mask substantial losses in individual expert capabilities. We introduce FusionEval, a benchm...

Shuo Cai, Yang-Gan Gu, Yuhang Liu et al. · 0 citations
#artificial intelligence Preprint Oct 2026

OnlineQAT: On-Policy Distillation for Ultra-Low-Bit Large Language Models

Quantization-aware training (QAT) can recover much of the accuracy lost when large language models are compressed below four bits. Existing re- covery stages, however, are commonly optimized on fixed completions or teacher-generated answers, whereas the deployed quantized model condi- tions on prefixes generated by its...

Wen-Jun Wang, He-Ping Li, Yang-Gan Gu et al. · 0 citations
#computer vision Sep 2026

InfiMed2: A Generalist Medical Multimodal Foundation Model from Contextual Evidence and Stability-Aware Supervision

This work introduces InfiMed2, a family of 4B and 27B generalist medical multimodal foundation models built around stage-aware data design, and curates a 55.68B-token corpus that combines broad clinical knowledge with context-rich biomedical visual evidence through source-specific processing.

Guang-Hao Zhu, Ze-Yu Liu, Zhitian Hou et al. · 0 citations
#machine learning Preprint Sep 2026

SMAT: Simple and Efficient Merge-Aware Training

SMAT (Simple MAT) is introduced, which jointly optimizes expert loss and expected loss at simulated merged parameters generated by sampling scaling coefficients, masks, and additive noise, and improves the mean score across five merging methods.

Yang-Gan Gu, Yuan-Yi Wang, Zhen Li et al. · 0 citations
#artificial intelligence Preprint Sep 2026

Routing Drift Alone Does Not Diagnose Failure in Merged MoE LLMs

Findings show that routing drift alone is insufficient evidence of routing failure, and source-informed corrections must be judged by their task-level intervention effects, and proposes Selective Router Repair as a case study, and finds that source-specialist token-likelihood advantages do not reliably identify benefic...

Yuan-Yi Wang, Yang-Gan Gu, Su Lu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.