Hadoop

Yarn Hortonworks

CLASSNAME - run the class named CLASSNAME COMMAND is one of: fs run a generic filesystem user client. HDFS - Fs Shell version print the version jar run a jar file. See Hadoop - Jar (Launch a java application) 
  * ''checknative [-a|-h]''  check native hadoop and compression libraries availability
  * ''distcp'' copy file or directories recursively. [[..:hdfs:distcp]] 
  * ''envvars''              display computed [[..:conf#environment_variable|Hadoop environment variables]]
  * ''archive'' create a hadoop archive. [[..:hdfs:archive]] 
  * ''classpath''            prints the [[..:classpath|class path]] needed to get the Hadoop jar and the required libraries
  * ''credential''           interact with credential providers [[auth]]
  * ''daemonlog''            get/set the log level for each [[..:daemon#log|daemon]]
  * ''trace''                view and modify Hadoop tracing settings. [[diagnostic]]
===== Example ===== * Hadoop Distributed File System (HDFS) ===== Documentation / Reference ===== * 2.9 reference




Discover More
Yarn Hortonworks
HDFS - DistCp (distributed inter/intra-cluster copy)

DistCp (distributed copy) is a tool used for large inter/intra-cluster copying distcp is a mapReduce application and run therefore in parallel. It expands a list of files and directories into input...
Yarn Hortonworks
HDFS - Fs Shell

Fs Shell is a client command line tool to manage HDFS. where: hadoop is the hadoop client hdfs is command is a file system command (ie ls, cat, ...) uri is For copy, you can also use...
Yarn Hortonworks
HDFS - Hadoop Archive file (har)

in the Hadoop context. An archive: exposes itself as a hdfs file system layer. All the fs shell commands in the archives work then but with a different . is immutable. Rename’s, deletes and...
Yarn Hortonworks
Hadoop - Authentication

in Hadoop See: Class: org.apache.hadoop.security.SecurityUtil.getAuthenticationMethod org.apache.hadoop.security.UserGroupInformation Hadoop...
Yarn Hortonworks
Hadoop - Classpath

Classpath to get the Hadoop jar and required libraries With hadoop
Yarn Hortonworks
Hadoop - Daemons / Process / Services

Hadoop process Common: Key management server Hdfs: Namenode – on the head node Datanode – on the worker nodes Rest API: Yarn: ResourceManager – on the head node Web Proxy...
Yarn Hortonworks
Hadoop - Diagnostic (Tracing)

Enabling Dapper-like Tracing in Hadoop See also: daemon log See also: hadoop trace command
Yarn Hortonworks
Hadoop - Environment variable

environment variable for the daemon can be modified in the following files hadoop-env.sh yarn-env.sh mapred-env.sh hadoop-user-functions.sh allows for advanced users to override some shell functionality...



Share this page:
Follow us:
Task Runner