Application of loop heat pipe cooling technology in multimodal large model servers

Abstract

With the implementation of multimodal large models in various industries such as military, medical care, industry, education, finance, and transportation, the demand for large-model computing power servers has witnessed explosive growth. The rapid iteration of artificial intelligence technologies and the surge of AIGC have further accelerated the growth in computing demand, driving continual increases in the power consumption and heat flux density of AI servers, while traditional air cooling is increasingly unable to meet the thermal management requirements of high-power-density chips. Since multimodal large models process data types like text, images, and voice, their high-computing-power servers need to be equipped with a large number of CPUs, high-performance GPUs/NPUs, and large-capacity memory to enable rapid model training and accurate logical reasoning. Therefore, there are extremely high requirements for the stable and reliable operation of high-computing-power servers. Performance fluctuations caused by prolonged overheating may lead to training interruptions. The greater the computing power, the higher the heat flux density, and efficient heat dissipation can control the chip temperature within a reasonable range. In view of the fact that liquid cooling is not suitable for some application scenarios, this paper applies loop heat pipe heat dissipation technology, innovates the form of loop heat pipe heat dissipation, designs the reservoir cavity in the evaporator diagonally, forms a loop heat pipe plate module, and constructs a loop heat pipe heat dissipation system to solve the heat dissipation problem of multimodal large-model computing power servers. Through thermal simulation analysis experiments, the effectiveness and feasibility of the loop heat pipe heat dissipation technology method are verified. Through high-temperature tests, the training and reasoning tasks of the multimodal large model proceed normally, and the computing power server operates in good condition, indicating that loop heat pipe cooling can effectively solve the heat dissipation problem of high-energy-consuming large-model computing power servers, and effectively support the promotion, deployment, and application of multimodal large models in environments such as "cloud-edge-end".