Curriculum

Scaling & Traffic

Load balancing at each layer, consistent hashing, rate limiting, and getting session state out of the way so a service can be cloned. Then search, which is the one subsystem that scales differently from everything else.
Free
5 modules · 17h · 25 lessons · Intermediate
Load Balancing
4 hours
5 lessons
Intermediate
Load Balancing
Free
05.1
Consistent Hashing
3 hours
5 lessons
Intermediate
Consistent Hashing
Free
05.2
Rate Limiting & Quotas
3 hours
5 lessons
Intermediate
Rate Limiting & Quotas
Free
05.3
Stateless Services & Session State
3 hours
5 lessons
Intermediate
Stateless Services & Session State
Free
05.4
Search & Indexing at Scale
4 hours
5 lessons
Intermediate
Search & Indexing at Scale
Free
05.5
The drills in this track
05.1 · Spread

Balance uneven traffic across uneven machines, then lose one of them mid-round.

05.2 · The Ring

Grow a cluster from 3 nodes to 30, one at a time, minimizing the keys that move.

05.3 · Throttle

Hold a global limit across twelve regions when the counter itself is the bottleneck.

05.4 · Cattle

Kill a random instance every thirty seconds. Keep every logged-in user logged in.

05.5 · Inverted

Serve typeahead over 200 million documents in under 50 ms at the ninety-ninth percentile.

Every track is free. Start anywhere.