#USA #Austin #Broadcom #AI Cooling #JetCool

JetCool and Broadcom's Pioneering Partnership in AI Cooling

JetCool, a prominent subsidiary of Flex, has taken a significant step towards improving AI infrastructure by joining forces with Broadcom. This collaboration aims to enhance cooling technologies for next-generation AI XPUs (accelerators) that demand high performance amid increasing silicon power densities. As AI workloads grow, so do the challenges in thermal management, making the need for innovative cooling solutions more critical than ever.

Recent advancements in AI systems have led to silicon power densities soaring into multi-kilowatt ranges per device. Such developments necessitate state-of-the-art thermal architectures that directly influence overall system performance, reliability over time, and deployment timeliness. To meet these requirements, JetCool and Broadcom have developed an advanced single-phase direct-to-chip cooling solution that integrates seamlessly with Broadcom's mechanical and thermal reference architecture, allowing for multi-kilowatt operational efficiency at heat flux levels touching 4 W/mm².

In light of the staggering demands of AI platforms, the collaboration emphasizes the importance of a cohesive integration strategy—combining silicon design, advanced packaging techniques, as well as thorough mechanical and thermal engineering at the early stages of development. This joint effort gears up high-performance AI platforms for both manufacturing feasibility and scalability, ensuring they are primed for success in diverse applications.

Strengthening the Fabric of AI Infrastructure

With JetCool's direct-to-chip liquid cooling at the forefront, this partnership not only serves to facilitate the manufacturing process through Flex's expansive global capabilities but also positions JetCool and Broadcom as leaders in the creation of robust AI infrastructures. Ken Kutzler, Vice President of AI Systems Development at Broadcom, noted the necessity for tight coordination across multiple engineering domains to support multi-kilowatt ASIC platforms effectively. The combination of JetCool's cooling technologies with Flex's large-scale manufacturing capabilities presents a clear pathway for transitioning advanced ASIC innovations into large-scale deployments for AI XPUs.

Dr. Bernie Malouin, Vice President of Liquid Cooling at Flex, further emphasized that cooling is becoming a pivotal design constraint that must be addressed in next-gen AI silicon. JetCool's innovatively designed cold plate technologies paired with Flex's global manufacturing reach unlock efficient thermal solutions tailored specifically for dense silicon configurations.

Future-Oriented Cooling Solutions

The collective vision of JetCool and Broadcom extends beyond immediate gains to ensure that their solutions are adaptable to future AI silicon advancements, especially as power densities are anticipated to increase even further. As technology continues to advance, JetCool remains committed to providing end-to-end liquid cooling infrastructures, which encompass an array of essential components from cold plates and manifolds to coolant distribution units (CDUs), all supported by Flex's manufacturing expertise to enable effective scaling within hyperscale AI ecosystems.

Conclusion

In summary, the partnership of JetCool and Broadcom signifies a noteworthy leap towards addressing the cooling challenges presented by modern AI technologies. By harnessing their combined strengths, they offer an innovative and production-ready foundation for future AI infrastructures, ensuring that high-density ASIC platforms achieve optimal performance while supporting sustainability and energy efficiency. As we move further into the era of advanced computing, strategic collaborations like this one are vital in shaping the landscape of AI deployment.