[AI Hardware & Systems Design Track]: Next Generation System Design for Maximizing ML Performance | Kisaco Research

Trends in cloud and HPC systems design are converging in the field of ML. As demands for ML compute performance continue to grow, certain trends are dictating systems design choices. Increasing server and rack density is a tried-and-tested tool for driving performance, but results in extreme heat, while packing GPUs and ASICs into AI servers is an inefficient long-term solution when memory bandwidth limits the total amount of FLOPS available at any moment. Some fairly fundamental re-designs are needed in the ML systems space, and this panel will examine what the next generation of systems will look like, what benefits they will bring, and how to get there.

Speaker(s): 
Moderator

Author:

Drew Matter

President & CEO
Mikros Technologies

Drew Matter leads Mikros Technologies, a designer and manufacturer of best-in-class direct liquid cold plates for AI/HPC, semiconductor testing, laser & optics, and power electronics.  Mikros provides leading microchannel thermal solutions in single-phase, 2-phase, DLC and immersion systems to leading companies around the world. 

Drew Matter

President & CEO
Mikros Technologies

Drew Matter leads Mikros Technologies, a designer and manufacturer of best-in-class direct liquid cold plates for AI/HPC, semiconductor testing, laser & optics, and power electronics.  Mikros provides leading microchannel thermal solutions in single-phase, 2-phase, DLC and immersion systems to leading companies around the world. 

Panellists

Author:

Greg Stover

Global Director, Hi-Tech Development
Vertiv

With more than 30 years of experience in data center efficiency optimization with large data center enterprise operators and industry leading VARs/Resellers, Greg champions the successful leveraging and utilization of Vertiv’s amazing and constantly evolving portfolio of thermal, power, monitoring & management solutions for the hyperscale, colocation, on-prem, DR and edge IoT ecosystems.

As a data center efficiency optimization enthusiast, Greg has a proven track record of bringing leading and bleeding edge cooling, power, monitoring and DCIM solutions and tools through introduction, implementation and successful execution, while staying keenly focused and aligned with client/enterprise/edge operator’s goals & objectives. Greg is a frequent presenter at industry conferences, trade shows and Integrator/VAR/Partner training events.

Greg Stover

Global Director, Hi-Tech Development
Vertiv

With more than 30 years of experience in data center efficiency optimization with large data center enterprise operators and industry leading VARs/Resellers, Greg champions the successful leveraging and utilization of Vertiv’s amazing and constantly evolving portfolio of thermal, power, monitoring & management solutions for the hyperscale, colocation, on-prem, DR and edge IoT ecosystems.

As a data center efficiency optimization enthusiast, Greg has a proven track record of bringing leading and bleeding edge cooling, power, monitoring and DCIM solutions and tools through introduction, implementation and successful execution, while staying keenly focused and aligned with client/enterprise/edge operator’s goals & objectives. Greg is a frequent presenter at industry conferences, trade shows and Integrator/VAR/Partner training events.

Author:

Dudy Cohen

VP Product Marketing
Drivenets

Dudy is a qualified manager and technology expert, with more than 30 years of experience in the networking industry. As a senior AI networking expert, he partners closely with the product and engineering teams to shape DriveNets’ vision for AI Networking, helping to deliver the high performance of a proprietary solution with a standards-based Ethernet implementation that provides unrivaled performance. Previously, Dudy served as the VP of Product Marketing at Ceragon. He also served as a Director of Solutions Engineering at Alvarion Ltd. Dudy holds an M.Sc.-E.E degree from the Tel Aviv University.

Dudy Cohen

VP Product Marketing
Drivenets

Dudy is a qualified manager and technology expert, with more than 30 years of experience in the networking industry. As a senior AI networking expert, he partners closely with the product and engineering teams to shape DriveNets’ vision for AI Networking, helping to deliver the high performance of a proprietary solution with a standards-based Ethernet implementation that provides unrivaled performance. Previously, Dudy served as the VP of Product Marketing at Ceragon. He also served as a Director of Solutions Engineering at Alvarion Ltd. Dudy holds an M.Sc.-E.E degree from the Tel Aviv University.

Author:

Albert Chen

Solutions Architect
Amphenol

Albert Chen

Solutions Architect
Amphenol