Author

Despoina Kosmopoulou

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#artificial intelligence Preprint Sep 2026

Attention-Aware Routing: Coupling Routing and Attention in MoEs

Attention-Aware Routing (AAR), which augments the router with temporal and spectral features extracted from a sliding window of attention weights that represent a summary of the model's contextual state, disentangled from the hidden state, is proposed.

Despoina Kosmopoulou, Anastasios Tsetsilas, Efthymios Georgiou et al. · 0 citations