Panel

Title: LLM Token Economy: How is networking going to play in the age of agents?

Abstract:

New business models in LLM workloads are reshaping the interconnect landscape. While ongoing challenges such as low latency, high bandwidth, and reliability persist, the emergence of scale-up networking creates new opportunities for performance with orders of magnitude more bandwidth. On the other end of the spectrum, applications are scaling across multiple data centers, trying to harness a million endpoints. The ability of software to deliver performance across the system holistically has become more challenging than ever, pushing the need for co-design. This HotI panel assembles experts from across the hardware and software stack to foster a discussion of these complex, multi-dimensional problems. The panel will explore the trade-offs between closed, and open AI models. Simultaneously, the panel will feature bleeding edge application developers, who will share their experiences leveraging current hardware, articulate their most pressing challenges, and envision the game-changing features that could revolutionize interconnect performance for their applications.

Moderator:

Peter Olcott Principal at First Spark Ventures

Peter Olcott is a Principal at First Spark Ventures, where he focuses on early-stage investments in AI and networking technologies. With a background in both engineering and business, Peter brings a unique perspective to the intersection of hardware and software innovation.

Panelists:

Phill Brown AI Systems Engineer at Meta	Phil leads the design of AI Systems for Meta, integrating high performance accelerators, networking and facilities to create the industry-leading training & inference systems we use to deliver our AI services to our customers. Previously Phil worked at Graphcore (a UK-based startup building AI accelerators) and at Cray developing and delivering large scale high performance computing systems. Phil holds a PhD in computational chemistry from the University of Bristol.
Davor Capalija Senior Fellow, AI Software and Architecture at Tenstorrent Inc.	TBD
Ethan Lockshin AE, Commercial at Groq	TBD
Sid Sheth Founder and CEO at d-Matrix	TBD