Data Processing - Operations / Operator / Filter


A data processing function takes an input and creates an output in a pipeline.

A data operator is also known as:


It may involve various function such as, including:

  • Validation with data type conversion – Ensuring that supplied data is “clean, correct and useful”. See also: Data Quality
  • Sorting – “arranging items in some sequence and/or in different sets.”
  • Summarization – reducing detail data to its main points.
  • Aggregation – combining multiple pieces of data.
  • Analysis – the “collection, organization, analysis, interpretation and presentation of data.”.
  • Reporting / visualization – list detail or summary data or computed information.
  • Classification – separates data into various categories.
  • Filtering - delete data via predicate
  • selection - select the data field

Powered by ComboStrap