Spark Engine - Logical Plan


Logical Plan in Spark.

Each data structure represents a logical plan that describes the computation required to produce the data.

When an action is invoked, Spark's query optimizer optimizes the logical plan and generates a physical plan for efficient execution in a parallel and distributed manner.



To explore the logical plan, use the explain function.

Powered by ComboStrap