Spark - pyspark

About

pyspark is the Spark Python API

It's also the name of a the pyspark command client

Function

We can use lambda functions wherever function objects are required, but they're restricted to a single expression.

Function literals are closures automatically passed to workers

Documentation / Reference

Task Runner