Spark - spark-sql cli

Card Puncher Data Processing

About

The Spark SQL CLI is a sparl sql client tool to run the Hive metastore service in local mode and execute queries input from the command line.

The Spark SQL CLI cannot talk to the Thrift JDBC server.

Management

Start

To start the Spark SQL CLI, run the following in the Spark directory:

./bin/spark-sql

See Spark hive configuration





Discover More
Card Puncher Data Processing
Spark - Configuration

The configuration of Spark is mostly: configuration around an app. runtime-environment The application web UI...
Idea Classpath Spark
Spark - Local Installation

A local installation is a spark installation on a single machine (generally a dev machine). The local master connection will start for you a local standalone spark installation on your machine. This...
Card Puncher Data Processing
Spark - SQL Framework

The Spark SQL Framework is a library based around an sql in order to create dataset, data frame with bindings in Python, Scala, Java, and R The Spark SQL Framework can execute SQL queries (Hive as...
Card Puncher Data Processing
Spark - Shell

The shell in different language. A shell create normally automatically a context (connection, session) given the name sc. Example of path: /usr/local/bin/spark-1.3.1-bin-hadoop2.6/bin/ ...
Card Puncher Data Processing
Spark SQL - Conf (Set)

of Spark in SQL is made through the SET statement. Same usage as See doc ref spark-sql Scala Java Python R...
Card Puncher Data Processing
Spark Sql - Client

You can also interact with the SQL interface over: JDBC/ODBC (ie the hiveserver2) (locally) beeline



Share this page:
Follow us:
Task Runner