Automated Gradient-Driven Parameter Sharing for Low-Resource Multilingual Speech-to-Text Translation
This work proposes a principled methodology to automatically determine layer-specific sharing patterns by mining training gradient information and employs three distinct analysis strategies: distance-based language clustering, self/cross-task divergence metrics for capacity allocation, and joint factorization coupled w...
Ruiyang Sun, Satoshi Nakamura
· 1 citation