Balancing Generality and Specialization: A Survey on AI Datacenter Hardware Architecture
This survey classifies industrial AI accelerators into four architectural categories and compares their compute and memory organizations, and examines how node-, rack-, and pod-scale interconnects support collective communication, and traces architectural evolution across accelerator generations.