Data Processing - Lambda Architecture (batch and stream processing)
Nathan Marz wrote a blog post describing the Lambda Architecture: How to beat the CAP theorem 1)
Lambda architecture is a data-processing architecture designed to handle massive quantities of data by taking advantage of both:
This approach to architecture attempts to balance:
- and fault-tolerance
- batch processing to provide comprehensive and accurate views of batch data,
- real-time stream processing to simultaneously provide views of online data.