Abstract In the talk, we will discuss the importance of latency as a key indicator of service quality, highlighting the challenges in measuring it accurately. Traditional methods like CPU utilization or request counts don’t capture the complexities of latency. We will explore the shortcomings of popular percentile metrics, especially for setting Service Level Objectives (SLOs) over extended periods. Our presentation will delve into the pitfalls of current practices and propose three practic...
