Airflow

1 - About

Airflow is a data platform to programmatically author, schedule, and monitor workflows written in Python.

Airflow workflow is a list of tasks that are dependent on execution not on data. The dependency graph is an execution one.

The idea behind workflow is that when workflows are defined as code, they become more maintainable, versionable, testable, and collaborative.

3 - Docker


curl -LO https://raw.githubusercontent.com/bitnami/bitnami-docker-airflow/master/docker-compose.yml
docker-compose up

See: https://github.com/bitnami/bitnami-docker-airflow

4 - Documentation / Reference


Data Science
Data Analysis
Statistics
Data Science
Linear Algebra Mathematics
Trigonometry

Powered by ComboStrap