ODI - Staging Area (or Work area)
About
ODI Knowledge Modules often use temporary objects to:
- stage temporary data for jobs optimization.
- execute some rules
- …
These temporary objects are always stored in a particular schema or directory called the Work Schema (or staging area).
These work schemas should be kept separate from the schema containing the application data (Data Schema).
Example:
- when the source is a flat file, and as such is not associated to an engine that supports operations (as concatenation, uppercase, …)
- all components (except the triggers) of the journalizing infrastructure (like all Data Integrator temporary objects, such as integration, error and loading tables)
Articles Related
Objects and work tables prefix
On the target data servers, you should almost certainly create a dedicated work schema. This will store:
- Temporary tables and views created during the loading phase if the source data is not in the same server as the target (C$ tables)
- Temporary tables created during the integration phase when using certain Integration Knowledge Modules (I$ tables)
- Permanent Error tables created during Data Quality Control phase when using Check Knowledge Modules (E$ tables)
- Permanent Journal tables, views and triggers created when the target is to be used as a source with Change Data Capture enabled by using Journalizing Knowledge Modules (J$ objects)
On “read-only” source data servers the following objects may be created depending on the way you want to address these servers:
- Views during Load phases, when using certain Loading Knowledge Modules
- Error tables when performing a “static” Data Quality Control (e.g. when controlling the data of a particular source schema independently of any load job)
- Journal tables, views and triggers when using Change Data Capture on the sources.
Where is the Staging Area ?
The staging area (or Work area) is first define when you create a physical schema but you can change it in the interface properties
