Data Warehouse Subsystems

Developing a data warehouse means assembling a lot of subsystems in order to create a whole and coherent data application.

Discovers the 34 Kimball Subsystems and drill down to discover them

Data Processing

Data processing has changed a lot since 1940 :) and luckily, we are not using punch card anymore.

Stream processing is becoming the norm in data integration task while batch processing stays the king in data analysis.

ENIAC, the first fully electronic digital computer , 1946

Data Modeling

Data Modeling is the translation of process into the world of data. The process is tricky but not insurmountable.

Dimensional Data Modeling

Dimensional Data Modeling permits you to model a (hyper)cube and analyse a process through different perspective. You define dimensions, measures and metrics.

Most programs process some input to produce some output; that’s pretty much the definition of computing.

Function

A Function is the basic block of all reusable code component. It is also becoming the central component of any serverless architecture.

Actually working on ...

Slow improvement is still improvement. We have worked on the following pages recently.

• Calcite (Farrago, Optiq)
• Hive - Engine
• Language - Compiler compilers or (lexer|parser) generators
• RDBMS - Sql Processing (Engine)
• calcite
• Consumer Analytics - Privacy
• SQLite - Table

Computing Division at the Department of the Treasury, mid 1920s

Table / Relation

The table format (known also as a relation) is the most important data structure used in data analysis. Did you know that its name originate from the medieval counting table ?