Load Balancing

Load balancing at each layer, consistent hashing, rate limiting, and getting session state out of the way so a service can be cloned. Then search, which is the one subsystem that scales differently from everything else.

This module is 05.1 of the 5 in Scaling & Traffic. It runs about 4 hours across 5 lessons, and closes with Spread — Balance uneven traffic across uneven machines, then lose one of them mid-round.