Skip to content

Author

Mona T. Diab

We have 4 of 13 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Sep 2026

Decoy Direction Optimization: A Post-Hoc Defense Against LLM Abliteration

Decoy Direction Optimization (DDO), a fast, post-hoc weight-editing defense that requires no base-model finetuning, is introduced, based on a simple mechanistic insight: ablation attacks rely on contrastive estimators to find the refusal direction.

Aashiq Muhamed, Mona T. Diab, Virginia Smith · 2 citations · ⚡1
#machine learning Preprint Sep 2026

RAPTOR: Role-Aware Private Training for Mixture-of-Experts

This work introduces RAPTOR - a Role-Aware Private Training framework, which alternates shared and expert optimization and targets each failure directly, using expert-specific clipping and noise together with a public expected-owner denominator and a count-independent update schedule that avoids conditioning on private...

Duc Dm, Khai Le-Duc, D. Nguyen et al. · 0 citations

DSPA: Dynamic SAE Steering for Data-Efficient Preference Alignment

This work proposes Dynamic SAE Steering for Preference Alignment (DSPA), an inference-time method that makes sparse autoencoder (SAE) steering prompt-conditional, and audits the SAE features DSPA modifies, finding that preference directions are dominated by discourse and stylistic signals.

J. Wedgwood, Aashiq Muhamed, Mona T. Diab et al. · 1 citation
Conference Open access 2026

Mechanistic Interpretability Should Prioritize Feature Consistency in Sparse Autoencoders

This work proposes the Pairwise Dictionary Mean Correlation Coefficient (PW-MCC) as an assignment-based metric to quantify consistency and demonstrates that high levels are achievable with appropriate architectural choices for TopK SAEs on LLM activations with appropriate architectural choices.

Xiangchen Song, Aashiq Muhamed, Yujian Zheng et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.