Stream - Back Pressure

> (Data|State) Management and Processing > (Data Processing|Data Integration) > (Stream|Pipe|Message Queue|Event Processing)

Table of Contents

1 - About

Back-pressure means a fast producer and slow consumer.

The issue of back-pressure comes when your consumer is not capable of processing income data in the same rate.

A streaming software will be implemented in this case in order to:

  • play the role of buffers
  • and having a sort of checkpoint or offset mechanism in order to be able to restart the process if needed.

The longer a consumer stay offline the higher will be the back-pressure.

Advertising
data/processing/stream/back-pressure.txt · Last modified: 2017/11/05 13:40 by gerardnico