Skip to content

Author

Abdullah Ali Alanazi

2 papers indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#small language model Open access Sep 2026

ExpertRelay: Virtual Memory for Mixture-of-Experts Language Models Across Heterogeneous Devices

Mixture-of-Experts (MoE) language models activate only a small subset of their parameters for each token, but they must still store all of them. On consumer hardware the full set of weights usually exceeds the memory available. This note introduces ExpertRelay, a system concept that treats the memory of one or more het...

Abdullah Ali Alanazi · 0 citations
#small language model Open access Sep 2026

ExpertRelay: Virtual Memory for Mixture-of-Experts Language Models Across Heterogeneous Devices

Mixture-of-Experts (MoE) language models activate only a small subset of their parameters for each token, but they must still store all of them. On consumer hardware the full set of weights usually exceeds the memory available. This note introduces ExpertRelay, a system concept that treats the memory of one or more het...

Abdullah Ali Alanazi · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.