IO - Throughput / Data Transfer Rate (DTR) / Bit Rate

Card Puncher Data Processing

About

Performance - (Throughput|Bandwidth|Transfer rate|Frequency) in storage device.

Throughput or data transfer rate (DTR) is :

  • the speed at which data can be transmitted between devices. ie the rate at which information can be read from or written to the storage device.
  • or the amount of data processed in a given amount of time

This is the principal performance characteristic of a storage device.

In computer data storage, throughput is usually expressed in terms of megabytes per second or MB/s, though bit rate may also be used.

As with latency, read rate and write rate may need to be differentiated.

Also accessing media sequentially, as opposed to randomly, typically yields maximum throughput.

The available throughput is distributed among the concurrent users.

The two major techniques for throughput computing are:

To calculate a maximum throughput (Megabytes per second) of a storage device, you have to set a workload with:

  • a Transfer Request Size to 64K
  • a Percent Read/Write Distribution to 100% Read,
  • and the Percent Random/Sequential Distribution to 100% Sequential.

To calculate a maximum I/O rate (I/O operations per second) of a storage device, you have to set a workload with:

  • a Transfer Request Size to 512 bytes (equivalent of one sector/block)
  • the Percent Read/Write Distribution to 100% Read,
  • and the Percent Random/Sequential Distribution to 100% Sequential.

If you rely on storage shared with other applications then the throughput performance is not guaranteed and you will likely see inconsistent response times for your operations.

Dd

A disk write throughput test that uses “dd if=/dev/urandom” is a CPU test. Write that to /dev/null and see what you observe.

Linux - dd Utility (Dataset definition) - (Throughput test validation)

Vizualization

IO - Data Path / Balanced System

Unit

Device

Bit rate by device:





Discover More
Card Puncher Data Processing
Computer - Channel

A channel is a device that conveys a digital bit stream, from: one or several senders (or transmitters) to one or several receivers. The term channel has two different meanings the whole medium...
Card Puncher Data Processing
Computer - Storage Device (Media)

A storage device is a that stores byte: machine instructions byte data byte It is an array of circuits that saves bit state (0 or 1). A storage device can be anything that can store and retrieve...
Card Puncher Data Processing
Data Storage - Data Striping (I/O parallelism)

In computer data storage, data striping is the technique of segmenting logically sequential data, such as a file, in a way that accesses of sequential segments are made to different physical storage devices....
Card Puncher Data Processing
Data Storage - The Buffer Cache (File System Cache)

All data accessed from files on the system that are performed through the use of read() and write() system calls, pass through the file system buffer cache. This buffer cache greatly speeds up disk access...
74hc00 Circuit
Device - Capacity

Any device / program has a certain capacity for transmitting/computing information, often measured by: its bandwidth in Hz or its data rate in bits per second. The process of predicting a...
Hierachy Storage
Disk - Characteristics

Storage technologies at all levels of the storage hierarchy can be differentiated by evaluating certain core characteristics as well as measuring characteristics specific to a particular implementation....
Two Physical Drives
Drive - RAID Technology Overview

Redundant array of independent disks (RAID) is the technology of grouping several physical drives in a computer into one or morelogical drives. Each logical drive appears to the operating system as...
Card Puncher Data Processing
I/O - (Input/Output|Read/Write) - Data Access

I/O devices can be interpreted as streams, as they produce or consume potentially unlimited data over time. IO = Input / Output = Writing and Reading data. It's an umbrella term that regroups IO transfer...
Card Puncher Data Processing
I/O - IOmeter (Workload Generator)

IOmeter is a disk-testing, IO workload generator tool which generate and measure storage performance. Iometer is pronounced “eye-OM-i-ter,” to rhyme with “thermometer.”...
Card Puncher Data Processing
I/O - Workload (Access Pattern)

Each server has unique workload characteristics. However there are some basic pattern that we can found in the storage demands. Although storage system workloads differ quantitatively in terms of the:...



Share this page:
Follow us:
Task Runner