HDFS - Heartbeat (Dead datanode)

> Database > (Apache) Hadoop > Hadoop Distributed File System (HDFS)

1 - About

Each DataNode sends a Heartbeat message to the NameNode periodically.

The NameNode marks DataNodes without recent Heartbeats as dead and does not forward any new IO requests to them.


3 - Configuration

The time-out to mark DataNodes dead is conservatively long (over 10 minutes by default) in order to avoid replication storm caused by state flapping of DataNodes.

3.1 - Interval

hdfs getconf -confKey dfs.heartbeat.interval