Jupyter - Notebook (.ipynb)


The Notebook frontend does something extra. In addition to running your code, it stores code and output, together with markdown notes, in an editable document called a notebook. When you save it, this is sent from your browser to the notebook server, which saves it on disk as a JSON file with a .ipynb extension.

Notebook as runtime container

Notebook as runtime container


When a Spark or Presto job executes from the scheduler, the source code is injected into a newly-created notebook and executed. That notebook then becomes an immutable historical record, containing all related artifacts —  including source code, parameters, runtime config, execution logs, error messages, and so on.


Documentation / Reference

Powered by ComboStrap