Osayamen Jonathan Aimuyo

Purlin: Separating Orchestration from the Datapath of Collectives

This work presents Purlin, a scale-up communication framework that separates semantics, orchestration, and the datapath for distributed inference from existing collective implementations, and introduces a shared orchestration protocol, Stage, Notify, And Consume (SNAC), which derives coordination from these specificati...