HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts
HiVe is proposed, a prompt tuning framework that models prompts at multiple levels and enables input-dependent specialization, and shows that HiVe consistently outperforms strong prompt tuning baselines across diverse tasks.
Hyeonjik Bae, Minyeol Kim, Susik Yoon
· 0 citations