Spark - Shell

Table of Contents

1 - About

The shell in different language.

A shell create normally automatically a context (connection, session) given the name sc.

3 - List

3.1 - Python

pyspark

Example of path: /usr/local/bin/spark-1.3.1-bin-hadoop2.6/bin/

Spark - pyspark

3.2 - Scala

spark-shell

3.3 - R

3.3.1 - SparkR

./bin/sparkR shell for R

Spark - SparkR API

3.3.2 - Sparklyr

R - Sparklyr inside RStudio for instance.

3.4 - Jupyter

Jupyter notebook

3.5 - SQL

Sql Shell

Spark - spark-sql cli

3.6 - Sparkling Water

See ML - SparklingWater (h20 inside Spark)


Data (State)
Data (State)
DataBase
Data Processing
Data Quality
Data Structure
Data Type
Data Warehouse
Data Visualization
Data Partition
Data Persistence
Data Concurrency

Data Science
Data Analysis
Statistics
Data Science
Linear Algebra Mathematics
Trigonometry

Modeling
Process
Logical Data Modeling
Relational Modeling
Dimensional Modeling
Automata

Data Type
Number
Time
Text
Collection
Relation (Table)
Cube
Tree
Key/Value
Graph
Spatial
Color
Log

Measure Levels
Order
Nominal
Discrete
Distance
Ratio

Code
Compiler
Lexical Parser
Grammar
Function
Testing
Debugging
Shipping
Data Type
Versioning
Design Pattern

Infrastructure
Operating System
Cryptography
Security
File System
Network
Process (Thread)
Computer
PerfCounter
Infra As Code

Marketing
Advertising
Analytics
Email

Web
Html
Dom
Http
Url
Css
Javascript
Selector
Browser
Web Services
OAuth

Contact
[email protected]
Privacy Policy
Status

Powered by ComboStrap