Hive - Configuration (Variable)

Card Puncher Data Processing

About

Configuration variable in Hive

Hive follows the Hadoop configuration guideline.

Properties

Level of persistence

Command

The configuration are variable

You can then use the set command to see or set them

Example: Which engine ?

set hive.execution.engine;
+----------------------------+--+
|            set             |
+----------------------------+--+
| hive.execution.engine=tez  |
+----------------------------+--+

Session

–hiveconf options. Example for the scratch directory

bin/hive or bin/beeline --hiveconf hive.exec.scratchdir=/tmp/mydir

Example:

hive --hiveconf hive.tez.container.size=1024

Application

See Hive - hive-site.xml

Management

List

set;

See

  • All
-- Show only the value set
set;
-- Show only the value not set with their default.
set -v;
  • One: Which engine ?
set hive.execution.engine;
+----------------------------+--+
|            set             |
+----------------------------+--+
| hive.execution.engine=tez  |
+----------------------------+--+

Show

The SHOW CONF command is a SQL command. You need to be connected.

show conf 'hive.execution.engine' ;
+----------+---------+-------------------------------------------------------------------------------------------------------------------------------+--+
| default  |  type   |                                                             desc                                                              |
+----------+---------+-------------------------------------------------------------------------------------------------------------------------------+--+
| mr       | STRING  | Expects one of [mr, tez, spark]. Chooses execution engine. Options are: mr (Map reduce, default), tez (hadoop 2 only), spark  |
+----------+---------+-------------------------------------------------------------------------------------------------------------------------------+--+

Directory

Example of Hive Home location:

  • /etc/hive/2.6.2.3-1/0
  • Hortonworks distribution
export HIVE_CONF_DIR=${HIVE_CONF_DIR:-/usr/hdp/current/hive-client/conf}

Documentation / Reference





Discover More
Card Puncher Data Processing
Hive - Authentication

hive.server2.authentication - property NONE: no authentication check –...
Card Puncher Data Processing
Hive - File Format (Storage format)

The file format is given at the creation of a table with the statement STORED AS. The default is given by the hive.default.fileformat...
Card Puncher Data Processing
Hive - HiveQL

HiveQL Tutorial is also a good reference Language Manual Reference Select...
Card Puncher Data Processing
Hive - Live Long And Process (LLAP)

Hive LLAP: is slider service (long-lived daemon) supports in-memory data caching was Introduce in Hive 2.0 Functionality such as caching, pre-fetching, some query processing and access control...
Card Puncher Data Processing
Hive - Lock

lock in hive turn off the hive.support.concurrency conf parameters....
Card Puncher Data Processing
Hive - Mode (Type of Metastore)

The mode of Hive refers to the type of metastore database: is an embedded database and is a remote database Running in local mode, means that Hive will use an embedded database (ie Derby)....
Card Puncher Data Processing
Hive - Schematool

Schematool is a offline command line tool to manage the metastore. This tool can be used to initialize the metastore schema for the current Hive version. Location: HOME/bin Hortonworks (/usr/hdp/current/hive-client/bin/hive...
Card Puncher Data Processing
Hive - Scratch Directory

Scratch space for Hive jobs. This directory is used by Hive to store: the plans for different map/reduce stages for the query intermediate outputs of plan operations The default value is...
Card Puncher Data Processing
Hive - Transport Mode

The transport mode is the network protcol used to made a connection HTTP mode is required when a proxy is needed between the client and server (for example, for load balancing or security reasons)....
Card Puncher Data Processing
Hive - URI (Connection URL )

cliservice/confhive.server2.thrift.http.path transportMode : . Default port for HTTP transport mode is 10001. See conf hive.server2.thrift.http.port clientURI Zookeeper Quorum Headnode (Example...



Share this page:
Follow us:
Task Runner