Preprint
Oct 2026
TRANSIT: Transparent Scale-in for Multi-Node LLM Training
TRANSIT is a transparent scale-in framework to enable multi-node model training on fewer GPUs while maintaining training efficiency by transparently leveraging CPU DRAM as an extension of GPU memory during distributed training. It achieves this through a user-space interposition layer, requiring no modifications to the...
Hyungyo Kim, Nicholas Satchanov, Hrishi Shah et al.
· 0 citations