Stream - (Software|Library)

> (Data|State) Management and Processing > (Data Processing|Data Integration) > (Stream|Pipe|Message Queue|Event Processing)

1 - About

Software, Library around the notion of stream

Advertising

3 - Distributed stream processing

Distributed stream processing frameworks such as:

4 - IO - built-in streams

These streams are built into the application itself: IO - Standard streams (stdin, stdout, stderr)

5 - Example

5.1 - Node.js

Node.js stream uses the pipe function to connect the source to the destination

src.pipe(dst)

.pipe(dst) returns dst so that you can chain together multiple .pipe calls together:

a.pipe(b).pipe(c).pipe(d)

which is the same as:

a.pipe(b);
b.pipe(c);
c.pipe(d);

which is the same as with the shell command-line pipe:

a | b | c | d
Advertising

5.2 - Java

5.3 - Implementation

A stream interface will expose two functions:

  • A src function that produces the objects (file, …)
  • A dest function that consumes the objects (file, …)

6 - Library

7 - Software

8 - Documentation / Reference

Advertising
data/processing/stream/software.txt · Last modified: 2019/02/16 17:40 by gerardnico