Data Processing - Lambda Architecture (batch and stream processing)


Nathan Marz wrote a blog post describing the Lambda Architecture: How to beat the CAP theorem 1)

Lambda architecture is a data-processing architecture designed to handle massive quantities of data by taking advantage of both:


This approach to architecture attempts to balance:

  • latency,
  • throughput,
  • and fault-tolerance

by using:

  • batch processing to provide comprehensive and accurate views of batch data,
  • real-time stream processing to simultaneously provide views of online data.

Documentation / Reference

Powered by ComboStrap