Skip to content

Author

Aiyuan Zhang

We have 2 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Jul 2026

Rethinking Heterogeneous LLM Merging: A Weighted Model Averaging Perspective

The results show that simple parameter averaging, when paired with lightweight dimensional adaptation and carefully controlled ratios, is a surprisingly strong baseline for heterogeneous LLM merging, suggesting that the limits of direct weighted fusion may also bound what more complex heterogeneous merging methods can...

Jiahe Fan, Yinghao Hou, Sixiang Chen et al. · 0 citations
Preprint Jul 2026

Training-Free Knowledge Transfer Across Model Scales through Activation-Guided Pruning

Evidence is provided that cross-scale heterogeneous fusion can succeed without explicit semantic alignment when the donor contribution is sufficiently concentrated and carefully selected, and that activation-guided extraction improves the quality of the transferable donor slice while preserving the small-ratio fusion r...

Jiahe Fan, Si Chen, Yinghao Hou et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.