Search & Indexing at Scale

Search & Indexing at Scale

The subsystem that scales unlike the others
Free
4h · 5 lessons
Overview

Load balancing at each layer, consistent hashing, rate limiting, and getting session state out of the way so a service can be cloned. Then search, which is the one subsystem that scales differently from everything else.

This module is 05.5 of the 5 in Scaling & Traffic. It runs about 4 hours across 5 lessons, and closes with Inverted — Serve typeahead over 200 million documents in under 50 ms at the ninety-ninth percentile.

Lessons
1. Inverted indexes and the posting list

Concept · 40 minutes

2. Analysis, tokenization and relevance

Concept · 35 minutes

3. Sharding and replicating a search index

Concept · 40 minutes

4. Near-real-time indexing and the refresh lag

Concept · 35 minutes

5. Autocomplete, typeahead and the trie

Concept · 35 minutes

Module information
Duration
4 hours
Lessons
5
Level
Intermediate
Track
Scaling & Traffic
Drill
Inverted
Price
Free

Related modules

Load Balancing
4 hours
5 lessons
Intermediate
Load Balancing
Free
05.1
Consistent Hashing
3 hours
5 lessons
Intermediate
Consistent Hashing
Free
05.2
Rate Limiting & Quotas
3 hours
5 lessons
Intermediate
Rate Limiting & Quotas
Free
05.3
Stateless Services & Session State
3 hours
5 lessons
Intermediate
Stateless Services & Session State
Free
05.4