Spark Engine - Partition

Spark Query Plan Generation

About

Data Partitions (Clustering of data) in Spark

Partition and executors

5 partitions and 3 executors

Rdd 5 Partition 3 Worker

Task Runner