Multi-tenant Kubernetes Use Cases for AI, Secure Computing and Data Services, and More
This work evaluates Kubernetes deployment on a Hewlett Packard Enterprise (HPE) Cray EX supercomputer with HPE Slingshot interconnect, called Isambard-AI, with co-design use cases that combines KubeRay, Ray, and vLLM to provide a distributed, sandboxed, persistent AI model hosting service targeting multi-tenant confide...