Spark - Log (Log4j)

Card Puncher Data Processing

List

  • Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
  • Setting default log level to “WARN”. To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).







Share this page:
Follow us:
Task Runner