What is vectorized execution?
Understand vectorized execution as batch processing instead of row-at-a-time work, especially in OLAP systems.
CORE CONCEPTS
Explain shared data-system principles with intuitive models and minimal examples.
This section connects the common foundations across projects: storage, execution, scheduling, data distribution, and query optimization. Understand the concept first, then return to the implementation.
Understand vectorized execution as batch processing instead of row-at-a-time work, especially in OLAP systems.
Why distributed systems redistribute data, and where shuffle cost comes from.
Understand Spark and Ray through computation models, scheduling, data work, and ecosystem boundaries.
Compare Spark and Daft across data abstractions, physical plans, ecosystem, and fit.
A learning path through execution, shuffle, Spark SQL, and streaming.
Understand row and column storage through access patterns, compression, scans, and write cost.
Understand Ray’s distributed application model through Tasks, Actors, and scheduling.
Notes on MPP analytics, partitioning, bucketing, table models, and acceleration.
Notes connecting DataFrames, physical plans, and distributed data processing.
A comparison framework for ClickHouse and Doris across data layout, execution, ecosystem, and operations.
A practical path through MergeTree, ordering keys, partitions, and query execution.