17.5 Transformations & DTPs
1. Transformation role
A BW transformation maps source fields and semantics into a target structure.
SAP documentation describes transformations as the place where source fields are converted into the format of the target, with rules for cleansing, integration and derivation.
2. DTP role
A Data Transfer Process transfers data from a source to a target and executes the transformation.
A simplified runtime is:
Source
|
Extraction
|
Transformation
|
DTP
|
Target
3. Transformation versus DTP
Do not combine the concepts.
Transformation defines how data changes.
DTP controls the transfer and runtime behavior.
4. Runtime engineering
A DTP design should consider:
- extraction mode,
- filters,
- package processing,
- error handling,
- runtime properties,
- target behavior,
- scheduling,
- monitoring.
5. Error handling
For critical flows, define:
- how bad records are isolated,
- how failed packages are identified,
- whether an error DTP is required,
- how corrected data is reprocessed,
- how business reconciliation is performed.
6. Process chains
Process chains orchestrate dependent BW processing.
A typical pattern:
Load source
|
Validate
|
Transform
|
DTP
|
Activate / optimize
|
Publish
Modern Datasphere task chains and BW bridge process chains solve related orchestration problems but are not identical implementations.
Exercise
Design a nightly Procurement pipeline with:
- source extraction,
- transformation,
- DTP,
- error handling,
- reconciliation,
- downstream publication.
Explain what should happen after a partial failure.