Preprint
Aug 2026
LLM Serving in the Wild: An Empirical Study of Frameworks, Methods, and System Designs
This study identifies and analyze five LLM-specific frameworks and examines how these frameworks and techniques are adopted individually and in combination, how adoption varies across categories of LLMs, and how repositories differ in intent, focus, use case, and architectural design.
Forough Majidi, Mohammad Mehdi Morovati, F. Khomh et al.
· 0 citations