An Availability-Oriented, Multi-Provider Architecture for Generative AI Services: A Fault-Injection Case Study
Applications built on third-party Generative AI APIs inherit the unreliability of those APIs. Providers rate-limit requests, exhaust free-tier quotas, deprecate models, and return server errors, any of which can break a dependent application. This paper presents an availability-oriented architecture that does not depen...