Consistent Hashing

Consistent Hashing

Adding a node without moving all the keys
Free
3h · 5 lessons
Overview

Load balancing at each layer, consistent hashing, rate limiting, and getting session state out of the way so a service can be cloned. Then search, which is the one subsystem that scales differently from everything else.

This module is 05.2 of the 5 in Scaling & Traffic. It runs about 3 hours across 5 lessons, and closes with The Ring — Grow a cluster from 3 nodes to 30, one at a time, minimizing the keys that move.

Lessons
1. Why modulo hashing fails on resize

Concept · 25 minutes

2. The ring, and virtual nodes

Concept · 40 minutes

3. Bounded loads and hot-key handling

Concept · 35 minutes

4. Rendezvous hashing as the alternative

Concept · 30 minutes

5. Implement a ring and measure the churn

Lab · 50 minutes

Module information
Duration
3 hours
Lessons
5
Level
Intermediate
Track
Scaling & Traffic
Drill
The Ring
Price
Free

Related modules

Rate Limiting & Quotas
3 hours
5 lessons
Intermediate
Rate Limiting & Quotas
Free
05.3
Stateless Services & Session State
3 hours
5 lessons
Intermediate
Stateless Services & Session State
Free
05.4
Search & Indexing at Scale
4 hours
5 lessons
Intermediate
Search & Indexing at Scale
Free
05.5
Load Balancing
4 hours
5 lessons
Intermediate
Load Balancing
Free
05.1