HDFS - Heartbeat (Dead datanode)

> Database > (Apache) Hadoop > Hadoop Distributed File System (HDFS)

1 - About

Each DataNode sends a Heartbeat message to the NameNode periodically.

The NameNode marks DataNodes without recent Heartbeats as dead and does not forward any new IO requests to them.

Advertising

3 - Configuration

The time-out to mark DataNodes dead is conservatively long (over 10 minutes by default) in order to avoid replication storm caused by state flapping of DataNodes.

3.1 - Interval

hdfs-site.xml
<property>
  <name>dfs.heartbeat.interval</name>
  <value>3</value>
</property>
hdfs getconf -confKey dfs.heartbeat.interval