Microsoft is progressing with a new cooling method for microchips, known as microfluidics, which could enhance energy efficiency in data centers. This technique involves the use of liquid coolant flowing directly into the silicon, as opposed to conventional cooling methods such as cold plates.
Initial laboratory tests indicated that microfluidics can dissipate heat three times more effectively than current cooling systems. Recently, Microsoft announced the successful development of a microfluidic cooling system integrated into a server conducting simulated Microsoft Teams meetings. If this innovation proves successful in real-world applications, it could significantly reduce the energy required for cooling data centers and potentially enable the use of powerful chips that current systems may struggle to maintain within safe temperature limits.
Next-generation data centers, particularly those designed for training and operating AI models, house more powerful chips, which generate substantial heat. Maintaining optimal temperatures is critical to ensure performance and minimize energy consumption. Typically, data centers rely on fans for cooling, while more advanced systems utilize copper cold plates with circulating fluid.
Microfluidic cooling channels are etched onto the chip’s surface, allowing coolant to flow directly to the chip. This design needs to balance channel depth to prevent clogging and protect the chip’s integrity. Microsoft applied artificial intelligence to optimize coolant distribution, drawing inspiration from natural patterns for efficient fluid flow. Their studies reported a 65 percent reduction in the maximum temperature increase of GPU silicon.
Advantages of microfluidics include direct coolant application, which streamlines the cooling process by eliminating insulating layers that retain heat, leading to energy conservation. Furthermore, this technology may help manage peak demands more efficiently, potentially allowing servers to operate at higher capacities with reduced overheating risks.
As microfluidics could facilitate tighter server arrangements and reduce facility requirements, it offers financial and environmental benefits. However, further lab testing and exploration of manufacturing adjustments, such as integrating channel etching during chip production, are essential before widespread adoption. Other companies, such as HP, are also developing similar microfluidic technologies, highlighting a broader industry interest in this area.
Source: https://www.theverge.com/report/785992/ai-chip-cooling-microsoft-microfluidic-energy-efficiency