Rate Limiting & Quotas

Rate Limiting & Quotas

Saying no, precisely and early
Free
3h · 5 lessons
Overview

Load balancing at each layer, consistent hashing, rate limiting, and getting session state out of the way so a service can be cloned. Then search, which is the one subsystem that scales differently from everything else.

This module is 05.3 of the 5 in Scaling & Traffic. It runs about 3 hours across 5 lessons, and closes with Throttle — Hold a global limit across twelve regions when the counter itself is the bottleneck.

Lessons
1. Token bucket, leaky bucket, sliding window

Concept · 40 minutes

2. Distributed counters without a hot key

Concept · 40 minutes

3. Per-user, per-tenant and global limits

Concept · 30 minutes

4. Backoff, jitter and the 429 contract

Concept · 30 minutes

5. Load shedding and admission control

Concept · 30 minutes

Module information
Duration
3 hours
Lessons
5
Level
Intermediate
Track
Scaling & Traffic
Drill
Throttle
Price
Free

Related modules

Stateless Services & Session State
3 hours
5 lessons
Intermediate
Stateless Services & Session State
Free
05.4
Search & Indexing at Scale
4 hours
5 lessons
Intermediate
Search & Indexing at Scale
Free
05.5
Load Balancing
4 hours
5 lessons
Intermediate
Load Balancing
Free
05.1
Consistent Hashing
3 hours
5 lessons
Intermediate
Consistent Hashing
Free
05.2