Invited Talk
Krishnan Geeyarpuram
Senior Distinguished Engineer and Senior Director of Product Architecture at NVIDIA
Title: Building Custom AI Infrastructure with NVLink Fusion
Abstract:
Rack-scale infrastructure is essential for today’s large-scale AI deployments. As large language models (LLMs) grow in complexity, flexible systems must efficiently run both enormous individual models and coordinated sets of smaller models, such as Mixture of Experts (MoE) architectures. The NVIDIA NVL72 GB300 —built with NVLink for scale-up and high-performance networking for scale-out—has become an industry standard. In this talk, we introduce NVLink Fusion: a new technology empowering hyperscalers to tailor both AI and compute subsystems, optimizing infrastructure for diverse workloads. We will demonstrate how NVLink Fusion extends the advantages of NVLink scale-up while integrating seamlessly with a robust partner ecosystem at the rack scale, ensuring performance and versatility for future AI demands.
Biography:
Krishnan Geeyarpuram is a Senior Distinguished Engineer and Senior Director of Product Architecture at NVIDIA. He leads the product architecture for next-generation server processors and custom silicon solutions, driving innovation for high-performance computing and data center applications.
He was previously at senior positions at Apple, where he architected custom silicon and system architecture for the Apple Watch at Apple and Intel, where he was an architect for Xeon processors. Krishnan holds multiple patents and is known for his technical leadership and ability to deliver complex products from concept to production. In his current role at NVIDIA, he works at the intersection of hardware innovation and product strategy.
He holds a master’s degree in Computer Science from the University of Texas at Austin and a Bachelor’s degree in Computer Science from IIT Chennai.
He was previously at senior positions at Apple, where he architected custom silicon and system architecture for the Apple Watch at Apple and Intel, where he was an architect for Xeon processors. Krishnan holds multiple patents and is known for his technical leadership and ability to deliver complex products from concept to production. In his current role at NVIDIA, he works at the intersection of hardware innovation and product strategy.
He holds a master’s degree in Computer Science from the University of Texas at Austin and a Bachelor’s degree in Computer Science from IIT Chennai.