HDFS - Heartbeat (Dead datanode)

1 - About

Each DataNode sends a Heartbeat message to the NameNode periodically.

The NameNode marks DataNodes without recent Heartbeats as dead and does not forward any new IO requests to them.

3 - Configuration

The time-out to mark DataNodes dead is conservatively long (over 10 minutes by default) in order to avoid replication storm caused by state flapping of DataNodes.

3.1 - Interval


<property>
  <name>dfs.heartbeat.interval</name>
  <value>3</value>
</property>

  • from the command line

hdfs getconf -confKey dfs.heartbeat.interval


Data Science
Data Analysis
Statistics
Data Science
Linear Algebra Mathematics
Trigonometry

Powered by ComboStrap