IO - Block (Batch on device)

Card Puncher Data Processing

About

A block is a unit of storage representing a fix number of bytes called the block size.

It's also known as the minimum unit of transfer.

It implements the concept of batch where data is organized into logical “blocks” for transmission between devices.

The block defines the smallest data unit processed. Within any application (file system included), you get blocks not bytes. If you want to read a particular byte, you need to ask a block and to read this block to get your byte.

Data thus structured are said to be blocked.

The process of putting data into blocks is called blocking. Blocking is used to facilitate the handling of the data-stream by the computer program receiving the data.

Blocked data are read a whole block at a time.

Breaking the file into pieces (block) allows it to be distributed as efficiently as possible using less bandwidth.

Property

Location

On memory, the location of the block is the offset.

Generally, when referring to a batch of data bytes, the following words are used to differentiate the location of the data:

Size

Example of block sizes:

  • 250 (bittorrent),
  • 512 (the most used)
  • 1024 bytes
  • 2048-byte blocks. (ISO 9660 CDs and images of them)

Fragmentation

A single block may be not full or contains only a part of the data unit (A file for a file system, a table for a database, …) which creates space inefficiency. See File System - Fragmentation

Blocked application

File System

On a file system level, the block abstraction is called a cluster which is a multiple of the device block size. It is the minimal unit of a IO request

The physical or logical volumes accessed via block I/O may be:

  • devices internal to a server, direct attached via SCSI or Fibre Channel,
  • or distant devices accessed via a storage area network (SAN) using a protocol such as iSCSI, or AoE.

Hardware Device

The block abstraction on a hardware device is the sector. A block has usually the size of a sector.

A disk is a block device. Blocking is almost universally employed when storing data to media.

The UNIX/Linux communities employ the term block to refer to a sector or group of sectors.

For example, the Linux fdisk utility normally displays partition table information using 512-byte blocks while also using sector to help describe a disk's size with its phrase, 63 sectors/track.

Virtual memory

For the virtual memory application, a logical block is called a memory page

Database

database management system such as Oracle Database or essbase use their own block I/O for improved performance and recoverability as compared to layering the DBMS on top of a file system.

Documentation / Reference





Discover More
Data System Architecture
Concurrency - Lock (Mutex)

A lock is a synchronizationmechanism designed to enforce a mutual exclusion of threads. A lock is also known as a mutex. Type: binary semaphore - yes / no Most locking designs block the execution...
Cryptography - Block Cipher

A Block cipher is a cipher where the unit of process is a block. A family of functions and their inverse functions that is parameterized by cryptographic keys. The functions map bit strings of a fixed...
Batch
Data Processing - Batch

The batch semantics means grouping data into batch in order to manipulate a lot of data at once as opposed to read and process each unit of data. The data is stored in a container: for disk...
Card Puncher Data Processing
Data Processing - Buffer (Batch concept in code)

Buffers are catalog containers of a (fixed|variable with max) amount of data or operations. memoryblocksdisk Without buffer, each read or write request is handled directly by the underlying layer (OS,...
Card Puncher Data Processing
Data Storage and Manipulation (Computer Architecture)

Computers are all manipulating Data. The efficiency of a computer is a function of: how fast it can manipulate the data (CPU speed) and how fast it can retrieve and store that data (CPU cache,...
Harddisk
Disk - Cylinder-head-sector disk geometry

Cylinder-head-sector, also known as CHS, was an early method for giving addresses to each physical block of data on a hard disk drive. See also : Cylinder-head-sector
Harddisk
Disk - Sector (Physical block)

A sector is the block (minimal persistent unit) on a disk at the physical level. It is not possible to modify any part of the disk smaller than a sector. To change a part of the disk smaller than a sector,...
Harddisk
Drive - Hard (disk|drive) (HDD) - Mass Storage - Flash

A disk is a storage device that refers to magnetic media, such as: a floppy disk, the disk in your computer's hard drive, an external hard drive. It's also known as mass storage device. Disks...
Essbase Data Block For D22 E3
Essbase - Data block

A data block is a multidimensional array structure that contains the data. each unique combinationsparse standard dimension membersdense dimension members A data block is created if at least one...
Undraw File Manager Re Ms29
File (System, Transfer, Storage)

This section is based on the File data structure. A file is: a logical grouping of related data (at the cluster size) identified through a path managed through a file system transferred through...



Share this page:
Follow us:
Task Runner