Skip to content
Preprint

Maia 200: A Software Defined Dataflow System for Large-scale AI Acceleration

Aug 2026 · 0 citations · 80 references
Computer Science

TL;DR

Maia 200 is introduced, an advanced AI accelerator delivering high performance-10 145 Tflop/s FP4 and 5072 Tflop/s FP8 within a 750W TDP and 7 TB/s HBM bandwidth, and a taxonomy of data management, inspired by Flynn's classification, highlights how SDLA addresses challenges in modern AI computing.

Abstract

We introduce Maia 200, an advanced AI accelerator delivering high performance-10 145 Tflop/s FP4 and 5072 Tflop/s FP8 within a 750W TDP and 7 TB/s HBM bandwidth. Maia exemplifies a new class of Software Defined Locally Accessed Dataflow Architectures (SDLA), which explicitly program dataflow engines to orchestrate highly specialized memories and data movement engines. This approach shifts the focus from today's thread-centric to data-movement-centric architecture, improving efficiency and scalability. Our taxonomy of data management, inspired by Flynn's classification, highlights how SDLA addresses challenges in modern AI computing. Maia 200 achieves significant cost and energy savings while supporting massive parallelism for AI inference workloads, making it a compelling solution for next-generation high-performance computing systems.

View source

Similar papers

Review Sep 2026

Balancing Generality and Specialization: A Survey on AI Datacenter Hardware Architecture

This survey classifies industrial AI accelerators into four architectural categories and compares their compute and memory organizations, and examines how node-, rack-, and pod-scale interconnects support collective communication, and traces architectural evolution across accelerator generations.

Yu-Feng Gu, Jia-Zhen Wang, Reetuparna Das · 0 citations
Preprint Sep 2026

CMD: An Integrated CGRA Framework with Cluster-Based Distributed Memory Design

CMD, an integrated CGRA framework featuring cluster-based distributed memory design with a co-designed compilation toolchain, is proposed, which includes a novel memory-aware mapper and a design space exploration mechanism that identifies the optimal memory architecture design for specific kernels.

Shang-Kun Li, Cheng Tan, Ze-Yu Li et al. · 0 citations
Preprint Sep 2026

FlashGPU-sim: Enabling GPU Modeling for Modern Architectures and AI Workloads

FlashGPU-sim is presented, an open-source, execution-driven, cycle-accurate GPU simulator for modern AI workloads that faithfully models modern hardware features such as asynchronous data movement, fine-grained synchronization, tensor-core execution, and distributed shared memory.

Si-Ying Yu, Yi-Xun Hong, Guo-Zhi Qiu et al. · 0 citations
Open access 2026

GTC: Architecture exploration for generation-in-time computing paradigm

Preliminary evidence that resolving context-dependent control through centralized generation can reduce software overhead and enable simpler edge hardware for efficient, adaptive computation is provided.

Peng-Ju Ren, Ge-Lin Fu, Sheng-Huan Liu et al. · 0 citations
Sep 2026

APPLICATION-LEVEL PERFORMANCE EVALUATION OF A MID-SCALE HPC SYSTEM FOR AI WORKLOADS

The study demonstrates that mid-range GPU infrastructure can effectively support modern AI applications, and provides practical deployment guidelines and demonstrate that mid-scale HPC systems can serve as a foundation for scalable and cost-effective AI infrastructure.

A. Temirbayev, Azati Yakufujiang · 0 citations

On the co-design of runtimes, systems and programming interfaces for HPC

(English) High-performance computing (HPC) platforms are evolving towards increasingly complex architectures: many-core CPUs with multi-level NUMA hierarchies, heterogeneity with multiple classes of accelerators and higher-capacity interconnects. The increasing complexity and variety of resources in these machines make...

David Álvarez Robert · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.