- This event has passed.
Ultra Ethernet Consortium
Title: Ultra Ethernet Consortium (UEC) overview – solving the AI/HPC Scale-Out Network Challenge
Abstract:
The industry race for an ever faster, better, lower total cost of ownership (TCO), easy to operate and lower CO2 footprint AI and HPC “At Scale” solutions, was never stronger, large scale distributed parallel processing is not new, but AI does present new challenges on the network, critical for best Job Completion Time (JCT). AI and HPC “At Scale” workloads are distributed parallel processing where tail latency directly impacts the Job Completion Time. The Network technology crucially affects the machine performance for these essentially parallel processing problems. Large Language Models (LLMs), as well as recommendation, are trained on clusters of thousands of GPUs, straining the ability to effectively manage tail latency. The network industry is responding with a set of well-coordinated technologies to modernize the communication stack on top of the ubiquitous Ethernet networks. In this talk, we will cover the key challenges of existing network technologies and the Ultra Ethernet Consortium’s direction to address them.
Speaker Biography:
Uri Elzur is a Senior Principal Engineer and leads the GPU network architecture work at Intel’s DCAI Group. In this role, he is responsible for creating networking related technical strategy and architecture, for AI/ML and HPC networks. Uri represents Intel on the Ultra Ethernet consortium and chairs its Technical Advisory Committee. His experience in hardware, networking and multiple open source top-to-bottom stack architectures, serves him well as a guide. Prior to this position, Uri has focused on SDN/NFV and has also represented Intel as VC Architecture for the Telco industry Open-O MANO community, ETSI Experiential Networked Intelligence (ENI), IETF NSH co-editor, OpenStack, OpenDaylight SDN (TSC and board), and worked on vSwitch technology and RDMA/iWARP.
Uri is a networking specialist with more than 30 years of industry experience and a proven track record of creating innovative product architectures, strategies and in Networking, Virtualization, Security etc.
Previously, Uri has held a position of a Sr. Director at Broadcom, managing the networking/NIC architecture team. In that role Uri led multiple innovations in the areas of Virtualization, TCP offload, RDMA, iSER and iSCSI/FCoE.