Most methods that optimize LLM prompts and agent workflows assume that task-specific output schemas, extraction instructions, and evaluation criteria are predefined. For scientific extraction agents, however, a short task goal may not fully determine these components, while specifying them manually is costly. We study...
Zi-Xiao Dong, Wei Yang, Zi-Hao Liu et al.· 0 citations
The results show that simple parameter averaging, when paired with lightweight dimensional adaptation and carefully controlled ratios, is a surprisingly strong baseline for heterogeneous LLM merging, suggesting that the limits of direct weighted fusion may also bound what more complex heterogeneous merging methods can...
Jiahe Fan, Yinghao Hou, Sixiang Chen et al.· 0 citations
Cross-scale heterogeneous MLLM fusion is recast as selective language-side reasoning transfer within a narrow, low-interference regime, rather than broad capability inheritance, to recast cross-scale capability transfer within a narrow, low-interference regime.
Yinghao Hou, Jiahe Fan, Yuanhao Pu et al.· arXiv.org· 0 citations
Evidence is provided that cross-scale heterogeneous fusion can succeed without explicit semantic alignment when the donor contribution is sufficiently concentrated and carefully selected, and that activation-guided extraction improves the quality of the transferable donor slice while preserving the small-ratio fusion r...
Jiahe Fan, Si Chen, Yinghao Hou et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.