Pipeline Modes
A pipeline’s mode refers to how it fetches data changes from the source and how those changes are applied to the destination table. Which mode a pipeline is in depends on the semantics of the source system, whether the destination is a warehouse or a lake, and, in some cases, on the settings of the pipeline itself.
Some sources, such as SaaS application APIs, require specific modes and cannot be changed.
To see a pipeline’s mode, go to the settings tab on the pipeline page, and look in the destination section. If you want to change the mode, you’ll need to recreate the pipeline and adjust the source or destination.
Pipeline Mode Summary
The following table summarizes how Extractions and Loads operate for each pipeline mode that Etleap supports. For more details on a specific mode, see the pages linked below.
| Mode | Extract from Source | Load to Destination |
|---|---|---|
| Update | New, updated, and deleted records | Append new, update existing, and remove deleted rows |
| Update with History Retention | New, updated, and deleted records | Append new row version, and set end date of previous row versions |
| Append | New records | Append new rows |
| Replace | All records | Replace all rows |