Data Processing - Lambda Architecture (batch and stream processing)
About
Nathan Marz wrote a blog post describing the Lambda Architecture: How to beat the CAP theorem 1)
Lambda architecture is a data-processing architecture designed to handle massive quantities of data by taking advantage of both:
methods.
This approach to architecture attempts to balance:
- latency,
- throughput,
- and fault-tolerance
by using:
- batch processing to provide comprehensive and accurate views of batch data,
- real-time stream processing to simultaneously provide views of online data.
