P063: LLM routing across clouds and models: Amazon Web Services study
Abstract
LLM routing across clouds and models: Amazon Web Services study Author: Sonu Kumar Singh (Senior Consultant — Cloud & AI Solutions Architecture, Capgemini US LLC) Professional Credential: Member, IEEE (Membership # 102728576) | ORCID: 0009-0002-9180-4946 Abstract Enterprise generative AI becomes dependable only when retrieval, tools, identity, policy, provenance, evaluation, and human oversight are engineered as a system around the model. Against this backdrop, the paper examines lLM routing across clouds and models in Amazon Web Services (AWS). It asks a focused question: How should lLM routing across clouds and models be designed, governed, and empirically evaluated for AWS? To keep the discussion testable, lLM routing across clouds and models is defined in operational terms. The paper focuses on the points where architecture choices become visible in behavior—how data is represented, how policies are enforced, how workloads fail and recover, and what evidence is left behind. That boundary is intentionally narrower than a feature survey and broad enough to capture the system-level trade-offs. The paper contributes a decision framework and a validation plan. It connects architecture to governance, reliability, cost, and measurable evidence, and it uses threat/risk modeling with operational validation as the primary research method. Where no experiment has been run, the paper says so directly and specifies what would have to be measured before an empirical conclusion could be defended. Architectural Research Scope Research Domain / Theme: Generative AI & Agentic Systems Architectural Scope: Amazon Web Services Core Research Question: How should llm routing across clouds and models be designed, governed, and empirically evaluated for AWS? Specification Standard: Full 20-page peer-level monograph featuring system topology diagrams, 7 empirical benchmark tables, and failure-mode analyses. Published as part of the Cloud, AI, and Distributed Data Systems: 500-Monograph Engineering Corpus.
