—The deep-learning scaling that drove the past decade of AI is colliding with hard limits in energy, data, robustness, and explainability, just as emerging applications demand the capabilities neural networks lack: reasoning, abstraction, and collaboration. The CoCoSys JUMP 2.0 center confronts this by co-designing cog...
Zi-Shen Wan, Yu Cao, S. K. Gupta et al.· IEEE Micro· 0 citations
DynamoServe is presented, a multi-tenant LLM serving framework that addresses challenges through three key innovations: leveraging stranded GPU memory to offload model weights and KV caches, mitigating resource fragmentation in multi-workload environments, and improving memory locality through coordinated data placemen...
Diman Zad Tootaghaj, Khaled Diab, Bob Lantz et al.· Conference on Applications,...· 0 citations
TRACE-Router is presented, a task-level routing framework that aligns routing with the unit of supervision, and learns routing policies that adapt to the workload while avoiding explicit task-complexity estimation.
