Data Processing - Lambda Architecture (batch and stream processing)

> (Data|State) Management and Processing > (Data Processing|Data Integration)

1 - About

Nathan Marz wrote a blog post describing the Lambda Architecture: How to beat the CAP theorem 1)

Lambda architecture is a data-processing architecture designed to handle massive quantities of data by taking advantage of both:

methods.

This approach to architecture attempts to balance:

  • latency,
  • throughput,
  • and fault-tolerance

by using:

  • batch processing to provide comprehensive and accurate views of batch data,
  • real-time stream processing to simultaneously provide views of online data.

Advertising

3 - Documentation / Reference

data/processing/lambda.txt · Last modified: 2018/10/21 21:38 by 162.158.78.158