InstantInfer: Enabling Fast LLM Cold Start with Communicating Finite Automata
This work proposes the Communicating Finite Automata (CFA) abstraction to systematically analyze cross-component optimization opportunities, and designs a programming framework to enable CFA-based component program refactoring that preserves the original sequential program structure while enabling safe concurrent component execution.