Stream - Pipeline (Stream Source Query)

Event Centric Thinking

About

A pipeline is a query for a stream.

A stream pipeline can be viewed as a query on the stream source.

Data Processing - (Pipeline | Compose | Chain)

A stream pipeline consists of:

  • a source (which might be an array, a collection, a generator function, an I/O channel, etc),
  • zero or more intermediate operations (which transform a stream into another stream, such as filter(Predicate)),
  • and a terminal operation (which produces a result).

Type of pipeline

Functional

In functional programming, Streams are lazy; computation on the source data is only performed when the terminal operation is initiated, and source elements are consumed only as needed.





Discover More
Event Centric Thinking
(Stream|Pipe|Message Queue|Event Processing)

From an abstract point of view, a stream is a sequence of aninfinite cardinality (size) delivered at unknown time intervals. list Streams: are inputs and outputs of operations may be also buffers...
Card Puncher Data Processing
Data Processing - (Pipeline | Compose | Chain)

A pipeline is a finite automata where: the data transition from one state to another via a series of transformations (work) A pipeline creates a composition relationship. A pipeline is also...
Event Centric Thinking
Stream - Operations

To perform a computation, stream operations are composed into a stream pipeline.
Event Centric Thinking
Stream - Processing

Stream processing is the reactive design of data processing. Something happened (Event), Subscribe to it (Streams) Streaming Processing is also known as : Incremental Processing. or reactive...
Event Centric Thinking
Stream - Query Optimizer

in Stream A query in a stream is called a pipeline If you're joining a stream to a table, and the table is small, then you can use a map join (aka a hash join with a small “build” side). But joining...



Share this page:
Follow us:
Task Runner