Instruct, Not Answer: Using Instruction Privileges in On-Policy Context Distillation
Results indicate that a general instruction, which applies equally to source and target domain examples, can be substantially more transferable than instance-specific gold in OPCD while maintaining in-domain performance.
Han-Tao Yu, Xiao-Xue Han, Udaya Ghai et al.
· 0 citations