Performance Tracing, profiling, and Analysis of Microservices Software and Hardware

Tutorial

Speakers: Mrittika Ganguli and David Cohen (Intel)

Abstract:
As monolith software services are being redesigned as microservices for cloud and edge applications, multiple aspects of performance need to be being considered. Whether latencies, RPS, mpps and gbps be the KPIs, performance is divided between compute and IO stack designs of different stacks and the master and worker thread models of services front-ended by ingress proxies and gRPC message designs. There is a fine balance between scalability as a design criteria vs number of client connections and requests to be served by the microservices. In this tutorial, we present a methodology to trace and benchmark a sample microservice and its infrastructure and business layer, to identify bottlenecks with multiple solution paths using Xeon CPUs, interpretations on hardware and software metrics leading to software optimizations. Observability system logs, traces, and telemetry represent a large dataset that is critical to the operations and long-term management of a data center. As such Observability data is managed by the same practices and supporting tools as an organization’s Data Lake. We’ll show how this is applied by collecting traces, running benchmarks, and supporting performance analysis.

Bios:
Mrittika Ganguli is a Principal Engineer and Director, Cloud Native Pathfinding in Intel’s Network and Edge Architecture team (NEX OCTO). She has 25+ years of experience in cloud hardware and software management, network and storage processing control and data plane, cloud orchestration, telemetry QOS and scheduling Architecture. She is active in CNCF and Open Infra opensource initiatives and initiated a Service Mesh Performance (SMP) index called Meshmark. She has a MS in CS and 70+ patents and multiple IEEE papers in this area.

David Cohen is a Senior Principal Engineer in Intel’s Data Center and Artificial Intelligence (DCAI) business unit where his focus is on large-scale Data Management systems at Intel’s Cloud customers.