Paraphrase Consensus Is Not Self-Consistency: Instruction Reliance and Robustness in VLA Policies
Vision-language-action policies fine-tuned on LIBERO are trained and evaluated on the same ten instruction strings, and rewording the instruction changes base OpenVLA's success by -38.0 points, although the stronger policies lose a much smaller fraction of it than base OpenVLA.