Papers for

web service reliability engineers

Papers whose findings have a practical use for this group, as judged from the abstract. Open a paper to read what it means in practice.

Slant reduces CPU use and latency in microservice traffic routing

Slant: Shaping Traffic for Resource-Efficient Microservices

Abstract: Microservice architectures rely on load balancers to distribute requests across service replicas, yet existing designs largely optimize for balanced routing without considering how routing shapes autoscaling signals and resource efficiency. We present Slant, a resource-aware load balancing framework that intentionally creates safe traffic imbalance to improve resource utilization. Slant profiles service-specific critical points, computes conservative multi-dimensional capacity, derives imbalance-aware routing weights that maintain hot and cold pods, and falls back to safer behavior under anomalies. By exposing clearer utilization signals, Slant works with existing vertical pod autoscalers (VPAs) without modification. Experiments on three microservice benchmarks show that Slant reduces allocated CPU cores by up to 26\% while lowering P99 latency by up to 18\% compared to Round-Robin. Under dynamic workloads, Slant triggers VPA scale-up 45\% faster and completes scale-in 40\% faster. Under anomalies, it recovers 40\% faster from pod failures and limits latency amplification to 1.8$\times$ versus 2.6$\times$ during downstream slowdowns.

Wed 28 OctDistributed, Parallel, and Cluster Computing
The gist
Microservices use load balancers to split work evenly among servers, but this balanced approach can hide how busy each server really is, making it harder to save resources. The authors created Slant, which deliberately sends uneven traffic to servers to better reveal usage patterns, helping automated tools adjust resources more quickly and efficiently. Slant improves CPU use by up to 26% and reduces delays by up to 18%, and it recovers faster from sudden problems. This method works with existing autoscaling tools without needing changes.
Open → 2610.38778v1