Arthur Szlam

SkillSmith: Learning to Compose Parametric Skills and Textual Knowledge

This work instantiate parametric learning via prefix-tuning and augment an LLM to ingest both prefix weights and rich textual data which capture relationships to a target capability, and synthesizes these inputs to perform instruction-steered parametric synthesis, directly outputting new prefix weights that manifest the target skill.