Data Processing - Architecture

Fault tolerance

Parallelism

High Latency

Delivery semantics

Operations and monitoring

Schema management

forward-compatible data architecture: the ability to add more applications that need to process the same data … differently

Data Processing - Lambda Architecture (batch and stream processing)

Data Warehouse - Layer (Architecture)

DataFlow Model

Map Reduce (MR) Framework

Data on the Outside vs. Data on the Inside - Data kept outside SQL has different characteristics from data kept inside. - Pat Helland