Yarn - Node (Worker|Agent)

Yarn Hortonworks

About

A worker node in the yarn context.

A node is materialized on the node machine side by the node manager process. Ie the version of the node is the version of node manager.

See Yarn - Cluster

Management

List

  • All nodes
yarn node -all
  • All running nodes
yarn node -list [-states] <States>[-all]

where:

  • -states filter nodes based on node state
  • -all list all nodes

Example:

Total Nodes:13
Node-Id                Node-State Node-Http-Address                        Number-of-Running-Containers
node01:8099            RUNNING node01:8042                               4
node02:8099            RUNNING node02:8042                              10
node03:8099            RUNNING node03:8042                              10
...

Status

yarn node -status <NodeId>

Group

See Yarn - Node Label

Installation

slider application will get node dependency installation automatically.

Version

You can see the Node manager version by nodes on the yarn ui node page.

http://yarnui/cluster/nodes





Discover More
Yarn Hortonworks
Hadoop - Metrics

on Hadoop JvmMetrics RetryCache/NameNodeRetryCache: RetryCache metrics is useful to monitor NameNode fail-over. Each metrics record contains Hostname tag. rpc rpcdetailed namenode:...
Yarn Hortonworks
Yarn - Architecture / Topology / Components

The Yarn (ie MapReduce) framework consists of three topology level: federation of independent cluster cluster application (that the Yarn cluster runs) Federation allow multiple independent...
Yarn Hortonworks
Yarn - Cluster

On a cluster level, Yarn consists of: a single global leader process (the central authority): ResourceManager, a per-node (worker|agent) NodeManager , The ResourceManager is the (head|leader)...
Yarn Hortonworks
Yarn - Localization

Localization is the process of copying/download remote resources onto the local file-system of each node. Instead of always accessing a resource remotely, it is copied to the local machine which can then...
Yarn Hortonworks
Yarn - Node Label

Node label is a way to group nodes with similar characteristics and applications can specify where to run.
Yarn Hortonworks
Yarn - Node Manager

The NodeManager (agent) is responsible for: containers, monitoring their resource usage (cpu, memory, disk, network) and reporting the same to the ResourceManager/Scheduler. The NodeManager is...
Yarn Hortonworks
Yarn - Slider (App shipping)

Slider is a collection of tools and technologies to simplify the packaging, deployment and management of long-running applications on YARN. Slider bypasses node installation for application and related...



Share this page:
Follow us:
Task Runner