T. Wheeler

Decomposing Refusal Steering in Mixture-of-Experts Models

This work extends this refusal steering method to three open-source Mixture-of-Experts (MoE) LLMs to decompose and better understand how refusal mechanisms operate across MoE components, finding that steering performance is uninhibited by the complex routing patterns inherent to the MoE architecture.