Load balancing

Distributing incoming requests across multiple instances so no single one is overwhelmed.

Beyond spreading load, a load balancer is where health checks pay off: an instance that stops reporting healthy is removed from rotation, so a partial failure degrades capacity instead of returning errors.