Iceberg Considerations
Iceberg destinations are currently in preview. As a result, there are the following caveats to consider.
Ingestion Modes
There are two different variations of Iceberg pipeline depending on the source entity that Etleap is extracting from.
Batch Iceberg Pipelines load data on a scheduled interval.
Streaming Iceberg Pipelines ingest data continuously as changes occur.
Supported Sources
Applications
| Source | Compatible | Notes |
|---|---|---|
| 15Five | Yes | Replace mode entities only |
| Active Campaign | Yes | Replace mode entities only |
| Bing Ads | No | |
| Blackline | Yes | Replace mode entities only |
| Braintree | Yes | Replace mode entities only |
| Coupa | Yes | Replace mode entities only |
| Criteo | Yes | Replace mode entities only |
| Dayforce | Yes | Replace mode entities only |
| Elastic Search | Yes | Replace mode entities only |
| Elluminate | Yes | Replace mode entities only |
| Eloqua | No | |
| ERPx | Yes | Replace mode entities only |
| Facebook Ads | No | |
| Freshcaller | Yes | Replace mode entities only |
| Freshchat | Yes | Replace mode entities only |
| Freshdesk | No | |
| Freshsales | Yes | Replace mode entities only |
| Gitlab | Yes | Replace mode entities only |
| Gong | Yes | Replace mode entities only |
| Google Ads | Yes | Replace mode entities only |
| Google Analytics (GA4) | No | |
| Google Sheets | Yes | |
| HubSpot | No | |
| Impact | Yes | Replace mode entities only |
| Intercom | Yes | Replace mode entities only |
| Jira | No | |
| JIRA Align | Yes | Replace mode entities only |
| Jira Software Cloud | Yes | Replace mode entities only |
| Kustomer | Yes | Replace mode entities only |
| LDAP | Yes | Replace mode entities only |
| LinkedIn Ads | Yes | Replace mode entities only |
| Marketo | No | |
| Microsoft Entra ID | Yes | |
| Microsoft Lists | No | |
| Mixpanel | No | |
| NetSuite | Yes | Replace mode entities only |
| Outlook | Yes | Replace mode entities only |
| Outreach | Yes | Replace mode entities only |
| Pinterest Ads | Yes | Replace mode entities only |
| Qualtrics | Yes | Replace mode entities only |
| Quora Ads | No | |
| Rave Medidata | Yes | Replace mode entities only |
| Recurly | Yes | Replace mode entities only |
| Reddit Ads | Yes | Replace mode entities only |
| Salesforce | Yes | CDC entities only |
| Salesforce Marketing Cloud | Yes | Replace mode entities only |
| SAP Concur | Yes | Replace mode entities only |
| SAP OData | Yes | Update mode entities are streaming |
| Seismic | Yes | Replace mode entities only |
| ServiceNow | No | |
| Shopify | Yes | Replace mode entities only |
| Skyward | No | |
| Snapchat Ads | Yes | Replace mode entities only |
| Square | Yes | Replace mode entities only |
| Stripe | Yes | |
| SumTotal | Yes | Replace mode entities only |
| The Trade Desk | Yes | Replace mode entities only |
| TikTok Ads | Yes | Replace mode entities only |
| Twilio | No | |
| UserVoice | Yes | Replace mode entities only |
| Veeva | Yes | Replace mode entities only |
| Workday Report | Yes | Replace mode entities only |
| Workfront | Yes | Replace mode entities only |
| X | Yes | Replace mode entities only |
| Yahoo DSP | No | |
| Zendesk | Yes | |
| Zoom Phone | Yes | Replace mode entities only |
| Zuora | Yes | Replace mode entities only |
Databases
| Source | Compatible | Notes |
|---|---|---|
| Azure SQL DB | No | |
| Azure SQL Managed Instance | Yes | CDC only |
| BigQuery | No | |
| Db2 | No | |
| MariaDB | Yes | CDC only |
| Microsoft SQL Server | Yes | CDC only |
| MongoDB | Yes | CDC only |
| MySQL | Yes | CDC only |
| Oracle | Yes | CDC only |
| PostgreSQL | Yes | CDC only |
| Redshift | No | |
| SAP HANA | Yes | CDC only |
| Snowflake | No |
Events
| Source | Compatible | Notes |
|---|---|---|
| Confluent Cloud | No | |
| Event Stream | Yes | |
| Kafka | No | |
| Kinesis | Yes | |
| SQS | No |
Files
| Source | Compatible | Notes |
|---|---|---|
| Azure Blob Storage | No | |
| Egnyte | Yes | |
| FTP | No | |
| Google Cloud Storage | No | |
| S3 Input | Yes | Only for event-driven pipelines |
| SFTP | No |
User Defined APIs
User defined APIs are not currently supported as sources for pipelines with Iceberg destinations.
Supported Transforms
Schema Changes
Schema changes are handled differently based on the ingestion mode of your pipeline.
Batch Iceberg Pipelines
| Change Type | Automatic Mode | Manual Mode |
|---|---|---|
| New JSON fields | Supported | Supported |
Streaming Iceberg Pipelines
| Change Type | Source | Automatic Mode | Manual Mode |
|---|---|---|---|
| New JSON fields | All | Supported | Not detected |
| Column additions | CDC Databases | Supported | Detected, requires a refresh |
| Column drops | CDC Databases | Supported | Detected, requires a refresh |
Limitations
The following limitations apply to pipelines with Iceberg destinations.
General Limitations
- Row errors result in a pipeline stoppage, please reach out to support for details on the parsing error.
CDC Iceberg Pipeline Limitations
- Replace-mode is not currently supported for CDC Iceberg pipelines.
- When using manual schema changes with CDC Iceberg destinations:
- Changes to the source schema are detected, but changing the script will always require a refresh.
- New JSON fields are not detected.
Event-Triggered Iceberg Pipeline Limitations
- Replace-mode is not currently supported for event-driven Iceberg pipelines.
- Only the following source file formats are supported for Iceberg pipelines:
Event Stream Iceberg Pipeline Limitations
- File and folder selection during pipeline creation is only used for deciding what sample to show in the Wrangler. When the pipeline is running, this selection is ignored and all events sent to the webhook listed on the source connection will be processed.
- Only events sent to the webhook within the last 365 days will be processed by the pipeline. Refreshing a pipeline will remove any data sent more than 365 days before the refresh was started.
- Pipelines that load to Iceberg can only be created from event streaming connections that were created after 2025-07-17.