On April 2nd SNIA hosted a CXL webinar to discuss where the technology currently is, and where it is headed. The Memory Guy was honored to play a part in this event.
Other speakers were Arthur Sainio, on behalf of SNIA, Mahesh Natu, on behalf of the CXL Consortium, and Torry Steed of SMART Modular, a company that has been one of the earliest providers of Continue reading “SNIA CXL Webinar Available On-Demand”
High-end xPUs (GPUs, TPUs, and other AI processors) use HBM memories to get the absolute highest memory bandwidth for training the Large Language Models (LLMs) used in today’s generative AI systems. These processors, used in the thousands by hyperscale datacenters, can consume a kilowatt each. As a result, they must dissipate a phenomenal quantity of heat. This has become a very challenging problem for these datacenters. (The Memory Guy should mention here that Objective Analysis plans soon to release a report on HBM.)
The problem has attracted the attention of Continue reading “AI xPUs to be Cooled by HBM”
