What are Application Metrics? ie Perfcounter, Performance Metrics, Operational data, Monitoring, telemetry

Scale Counter Graph

About

This section is about the collection and calculation of metrics in the monitoring context.

These (counter|numbers) are or we will derive averages from them. There is no way to figure out from the data, if you got from one point to another in an horizontal and constant line.

Type

Primitives Metrics Type are called statistical collector

Characteristics

Registry

They are generally locally grouped in a registry in order to batch the data collection.

Dimensionality

Time serie data may be classified via:

  • dimension - the event is enriched with tag key/value pairs. (AppOptics, Atlas, Azure Monitor, Cloudwatch, Datadog, Datadog StatsD, Dynatrace, Elastic, Humio, Influx, KairosDB, New Relic, Prometheus, SignalFx, Sysdig StatsD, Telegraf StatsD, Wavefront)
  • hierarchy - the name is a flat hierarchical metric name (Graphite, Ganglia, JMX, Etsy StatsD)
  • or both

dimensions are also known as tags

Hierarchy Example :

  • Atlas (CamelCase)- httpServerRequests
  • Graphite (Point separator)- http.server.requests
  • InfluxDB and Prometheus separated by _ - http_server_requests

Aggregation Processing

The aggregation of a set of samples over a prescribed time interval (Rate aggregation) may be performed:

  • Client Side (AppOptics, Atlas, Azure Monitor, Datadog, Elastic, Graphite, Ganglia, Humio, Influx, JMX, Kairos, New Relic, all StatsD flavors, SignalFx)
  • or Server-side (Prometheus, Wavefront)

Example: conversion of discrete samples (such as counts) to a rate.

Not all measurements are reported or best viewed as a rate. For example, gauge values are not rates.

Metrics Collection

The collection of metrics may be done:

  • client side via client pushes (AppOptics, Atlas, Azure Monitor, Datadog, Elastic, Graphite, Ganglia, Humio, Influx, JMX, Kairos, New Relic, SignalFx, Wavefront)
  • server side via server polls (Prometheus, all StatsD flavors)

Steps / Lifecycle

They are:

Alerting:

Category

Machine data example:

Sensor

  • temperature,
  • speed,
  • voltage,
  • number of printouts

Service Metrics

See SLI: Service Level Indicators:

Event

Some monitoring systems can also capture events:

  • Changes: Internal code releases, builds, and build failures
  • Alerts: Internally generated alerts or third-party notifications
  • Scaling events: Adding or subtracting hosts

Property

Scale and Persistence

  • last 2 hours at 1 minute resolution,
  • last 24 hours at 10 minute resolution,
  • last 3 days with 1 hour resolution,
  • last 7 days at 2 hours resolution

X-scale (Minor/Major Tick)

Scale Counter Graph

Reference





Discover More
Data System Architecture
(Data Type | Data Structure)

A type is the classification of value according to: how they are represented (the structure) the properties that they have (the operations) A data structure is a complex data type that can not be...
Scale Counter Graph
Collectd (Perf metrics collector)

collectd is a daemon which collects system and application performance metrics periodically and provides mechanisms to store the values. (written in c) The binary...
Card Puncher Data Processing
Computer Monitoring / Operational Intelligence / Real Time Monitoring

Computer Monitoring / Operational Intelligence / Real Time Monitoring Monitoring is the process of defining metrics and alerts in order to respond to a performance degradation where the acceptable level...
Scale Counter Graph
Counter - Collector

Metrics collector query and collects metrics in order to be able to send them to a metrics server Log Collector In a instrumented application, reporter are a client piece of code which: process...
Scale Counter Graph
Counter - Simple Network Management Protocol (SNMP)

Simple Network Management Protocol (SNMP) can be used to query devices for the values of counters they keep. Simple Network Management Protocol (SNMP) is a widely used protocol for monitoring the health...
Data System Architecture
Data - Machine Data

machine data are data not created by human whereas human data are. machine data are the source of event-data application.
Metrics Soup
Dimensional Data Modeling - Metrics - Key Performance indicators (KPI)

A (performance) metric is an calculated and aggregated measure of activities of: a person, a process, (see ) an event, or an institution organization. Metrics are numeric values. A metric...
Event Conceptual Model
Event (Timed Measure|Action)

An event is a timed observed physical reality described by: space (location) participant. The observations describing the event are defined by the nature or physics of the observable, the observation...
Yarn Hortonworks
Hadoop - Metrics

on Hadoop JvmMetrics RetryCache/NameNodeRetryCache: RetryCache metrics is useful to monitor NameNode fail-over. Each metrics record contains Hostname tag. rpc rpcdetailed namenode:...



Share this page:
Follow us:
Task Runner