Tail latency amplification
A page waits on its slowest server, so rare slowness is common.
Part of Scalability.
Read first
- Percentiles
The average describes nobody; watch the median and the tail.
Read next
- Scaling up and out
A bigger machine while it’s simple; more machines for what holds no data.
Related
- The Tail at Scale
Dean and Barroso, 2013.