The Adaptive Knowledge Distillation Framework (AKDF), a unified training approach that simultaneously com-presses LLMs and embeds ownership signals for copyright assurance, is introduced, providing a practical path to-ward bandwidth-efficient and ownership-aware deployment of large-scale language models.
Feng Jiang, Hong-Hui Xu, Daehee Seo et al.· Tsinghua Science and Technol...· 0 citations
FedTAR is proposed, a task-aware federated fine-tuning method for MoE-based LLMs that establishes the association between local updates and task preference via routing outputs and preserves expert specialization and mitigates destructive interference among heterogeneous clients.
Ting-Qi Wang, Hongyu Ke, Hao-Xin Wang et al.· 0 citations
ClinX is introduced, an end-to-end multimodal PHI sanitization framework for medical image-text data, and results show that OCR-only masking is not sufficient as a standalone solution, and restoration-based sanitization better preserves clinically relevant visual context while sharply reducing recoverable PHI.
S. Shrestha, Zongxing Xie, Chen Zhao et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.