The swap readout is proposed, which reads each student checkpoint's feature activations on its own, measuring how training changes the student's use of each feature, even for checkpoints unseen by the crosscoder.
Zi-Chao Yu, Qian-Shuo Ye, Xu Wang et al.· 0 citations
It is shown that persistent sycophancy reduction does not guarantee stronger direct refusal, while identifying recovery under user pressure as a distinct, conditional benefit of training intervention.
A family of chunk-level SAEs that encode mean-pooled activations over chunks, each a contiguous span of tokens: Mean-Chunk reconstructs the observed chunk, Cross-Chunk predicts an independently processed neighbor, and Joint-Chunk combines both targets are introduced.
Xu Wang, Yi-Fan Yang, Ting-Ting Yu et al.· 0 citations
TIDE (Token-level Independent Deficit-Excess correction), which applies bounded Hellinger shaping to suppress the most severe sampled excesses and an analytic teacher top-$K$ injection to restore deficient probability mass without requiring deficit tokens to be sampled, is proposed.
Zi-Chao Yu, Chengzhi Yu, Sheng-Ze Xu et al.· 4 citations
This paper proposesNeighbor Integrated Feature Selection (NIFS), a plug-and-play strategy that leverages representation similarity to improve feature selection for steering and demonstrates consistent performance gains over conventional top-$k$ selection.
Yutang Liu, Xu Wang, Di-Fan Zou· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.