Azure Data Lake - JAR

Card Puncher Data Processing

About

Java Jar library

Management

Coordinates

  • hadoop-azure-datalake-X.X.X.jar
  • azure-data-lake-store-X.X.X.jar

http://hadoop.apache.org/docs/r3.0.0-alpha2/hadoop-azure-datalake/index.html

From Java Getting started. The Data Lake Store SDK uses slf4j logging façade, which lets you choose from a number of popular logging frameworks, like log4j, Java logging, logback, etc., or no logging.

 <dependencies>
   <dependency>
     <groupId>com.microsoft.azure</groupId>
     <artifactId>azure-data-lake-store-sdk</artifactId>
     <version>2.1.5</version>
   </dependency>
   <dependency>
     <groupId>org.slf4j</groupId>
     <artifactId>slf4j-nop</artifactId>
     <version>1.7.21</version>
   </dependency>
 </dependencies>

Location

  • On cluster: /usr/lib/hdinsight-datalake/





Discover More
Card Puncher Data Processing
Spark - Jar

Jar can be defined in a spark-submit command via Jar file with the: --jars option. It define the path to jars file that will be automatically transferred to the cluster. Maven coordinates: --package...



Share this page:
Follow us:
Task Runner