MapReduce - Pipeline

Mapreduce Pipeline


A MapReduce app implements a pipeline


(input) -> <k1, v1> 
    -> map -> <k2, v2> 
    -> combine -> <k2, v2> 
    -> sort -> <k3, v3> 
    -> reduce -> <k4, v4> 
    -> (output)


Mapreduce Pipeline

Discover More
Card Puncher Data Processing
Data Processing - (Pipeline | Compose | Chain)

A pipeline is a finite automata where: the data transition from one state to another via a series of transformations (work) A pipeline creates a composition relationship. A pipeline is also...
Mapreduce Pipeline
Map Reduce - Data (Stream) - pairs

MapReduce framework types the Writable interface (to be serializable) the WritableComparable interface (to facilitate sorting) pipeline

Share this page:
Follow us:
Task Runner