Systematic Exploration of Multi-core Architectures for Efficient LLM Serving using ArguSim
WaferAI-SIM enables simulator-driven co-design of LLM serving strategies and multi-core accelerator architectures, targeting the early design stage in which emerging platforms are not yet broadly available for empirical serving studies, and provides guidance for co-designing hardware architectures and serving strategie...