Robust Failure, Conservative Repair: Textual Knowledge Distillation from Cross-Model Failures
Early experiment shows rule distillation from a single model's failures underperforms the baseline cheat sheet on non-source model families, which motivates Robust Failure, Conservative Repair (RFCR), a textual distillation procedure that derives rules from failures shared across models, sharpens their application boun...
Andrew Ren, Haokun Liu, Chen-Hao Tan
· 0 citations