Data Processing - Buffer (Batch concept in code)

1 - About

Data Processing - Batch in code.

Buffers are containers of a (fixed|variable with max) amount of data or operations.

Buffers live in the memory (ie created by code structure) whereas a blocks lives in the disk.

Without buffer, each read or write request is handled directly by the underlying layer (OS, Database, …) . This can make a program much less efficient, since each such request often triggers other operations that may be relatively expensive.. For instance, for an OS layer

  • disk access,
  • network activity,
  • or some other operation

Example of buffered data:

3 - List of buffer implementation

4 - Flush Operation

Flushing the buffer means that you write data to an entity (mostly a file).

5 - Documentation / Reference

data/processing/buffer.txt · Last modified: 2018/12/08 14:57 by