Table of Contents

About

The shell in different language.

A shell create normally automatically a context (connection, session) given the name sc.

List

Python

pyspark

Example of path: /usr/local/bin/spark-1.3.1-bin-hadoop2.6/bin/

Spark - pyspark

Scala

spark-shell

R

SparkR

./bin/sparkR shell for R

Spark - SparkR API

Sparklyr

Spark inside RStudio for instance.

Jupyter

Jupyter notebook

SQL

Sql Shell

Spark - spark-sql cli

Sparkling Water

See ML - SparklingWater (h20 inside Spark)