Trends in cloud and HPC systems design are converging in the field of ML. As demands for ML compute performance continue to grow, certain trends are dictating systems design choices. Increasing server and rack density is a tried-and-tested tool for driving performance, but results in extreme heat, while packing GPUs and ASICs into AI servers is an inefficient long-term solution when memory bandwidth limits the total amount of FLOPS available at any moment. Some fairly fundamental re-designs are needed in the ML systems space, and this panel will examine what the next generation of systems will look like, what benefits they will bring, and how to get there.
Drew Matter
Drew Matter serves as Vice President at Mikros Technologies, a premier designer and manufacturer of DLC single-phase and 2-phase cold plates and loops. Mikros works closely with AI/ML system designers to provide highly-optimized thermal management solutions with industry-leading heat transfer performance to improve the power, performance, packaging, reliability and sustainability of their systems.
Greg Stover
With more than 30 years of experience in data center efficiency optimization with large data center enterprise operators and industry leading VARs/Resellers, Greg champions the successful leveraging and utilization of Vertiv’s amazing and constantly evolving portfolio of thermal, power, monitoring & management solutions for the hyperscale, colocation, on-prem, DR and edge IoT ecosystems.
As a data center efficiency optimization enthusiast, Greg has a proven track record of bringing leading and bleeding edge cooling, power, monitoring and DCIM solutions and tools through introduction, implementation and successful execution, while staying keenly focused and aligned with client/enterprise/edge operator’s goals & objectives. Greg is a frequent presenter at industry conferences, trade shows and Integrator/VAR/Partner training events.
Dudy Cohen
Dudy is a qualified manager and technology expert, with more than 30 years of experience in the networking industry. As a senior AI networking expert, he partners closely with the product and engineering teams to shape DriveNets’ vision for AI Networking, helping to deliver the high performance of a proprietary solution with a standards-based Ethernet implementation that provides unrivaled performance. Previously, Dudy served as the VP of Product Marketing at Ceragon. He also served as a Director of Solutions Engineering at Alvarion Ltd. Dudy holds an M.Sc.-E.E degree from the Tel Aviv University.
