job history server
For map reduce job, see history server
It lists the following jobs type:
./sbin/start-history-server.sh
web interface: http://server:18080 by default
For azure hdinsight: https://clusterName.azurehdinsight.net/sparkhistory/
(see spark.history.provider below),
spark.eventLog.enabled true
spark.eventLog.dir hdfs://namenode/shared/spark-logs