Engineering / advanced
Design the data beneath intelligent systems
Connect storage internals, transactions, event streams, and retrieval indexes to correctness and operating cost.
Your route through engineering
Follow the path or begin with a question. Every lesson is open.
Your place, at your pace. Progress is optional and saved only in this browser when available.
Read / explore / reason
Inside this module
Module 01 advanced
Design the data beneath intelligent systems
Connect storage internals, transactions, event streams, and retrieval indexes to correctness and operating cost.
- 01
Data models and access paths
Choose keys, constraints, and indexes from concrete query shapes and measured selectivity rather than database fashion.
29 min - 02
Write-ahead logging and recovery
Trace the ordering that makes acknowledged writes recoverable and calculate a realistic replay and restoration budget.
30 min - 03
MVCC and isolation
Use concurrent transaction histories to distinguish snapshots, write conflicts, write skew, and serializable retry obligations.
33 min - 04
LSM trees and compaction
Trace writes through memory and sorted runs, then reason about amplification, tombstones, and compaction debt.
31 min - 05
Partitioning and hot keys
Choose partition ownership and rebalance mechanics while accounting for skew, ordering, and the limits of adding shards.
30 min - 06
Stream processing and event time
Define window completeness, watermark behavior, state retention, and sink recovery for out-of-order event streams.
32 min - 07
Change data capture
Build a consistent database-to-index projection by joining a snapshot to a retained log and applying replayable changes.
31 min - 08
Schema evolution and data contracts
Separate serialization compatibility from semantic correctness and migrate producers, readers, and historical data safely.
30 min - 09
Vector indexes and retrieval
Define a distance metric, establish an exact baseline, and evaluate approximate retrieval under filters and changing data.
33 min - 10
Lakehouse transactions and tables
Explain atomic table snapshots, optimistic commit validation, delete semantics, and safe cleanup on object storage.
33 min