Connecting to cloud based data sources
With the Celonis Platform you can connect to a number of cloud based source systems.
The below matrices highlight the available features for our commonly supported cloud based source systems. For other cloud based source systems, such as Amazon S3 and Google hosted products, see: Additional cloud based sources.
Cloud extractor feature matrix
When viewing the below matrices, there are two status indicators:
Status Indicator | Status Description |
---|---|
This feature is supported and can be used with the extractor builder. | |
This feature is not currently supported and can't be used with the extractor builder. |
Connection settings
The following connection setting features are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Pseudonmyzation algorithms | The applied pseudonymization algorithms can be selected in the advanced settings when configuring the connection. | |||||||||
Parallelization of requests | The max. number of parallel requests the extractor makes can be customized in the advanced settings when configuring the extractor. |
Table configuration
The following table configuration features are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Rename target table | The name of the table which is created in the Celonis Platform can be customized as part of the table configuration. | |||||||||
Table joins | It is possible to join the extracted table on another table during the extraction. | |||||||||
Filtering | Filters can be applied on table level based on the supported filtering operators. For a full overview, see: Supported filtering operators. | |||||||||
Filtering on dependent tables | Filters can be applied for dependent tables. |
Supported filtering operators
The following filtering operators are supported based on the source system you're connecting to:
Column configuration
The following column configuration features are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Column selection | The subset of columns that should be extracted can be selected. | |||||||||
Column pseudonymization | The columns that should be pseudonymized with the chosen algorithm can be selected. | |||||||||
Customize primary key | Addtitional columns can be added to the default primary key definition. | |||||||||
Casting of data types | The data type with which the extracted columns are inserted to the Celonis Platform can be customized. | |||||||||
String length configuration | Allows the modification of the default length (80 characters) of String-type columns. |
Extractor execution configuration
The following extractor execution configuration options are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Batch size configuration | Allows specifiying the batch size (in records) for one extraction request. | |||||||||
Split job by days | Allows specifying a time range in days by which the extraction jobs are split. | |||||||||
Rolling page size | Allows specifying the buffer how many records should be rolled over from the previous request when doing pagination. | |||||||||
Partitioning | Allows the partitioning of an extraction into multiple batches based on applied filters. | |||||||||
Extract display value columns | Allows the retrieval of so-called display values for specific columns in ServiceNow. The display values are added as additional columns in the extraction. |
Metadata resolution
The following metadata resolution features are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Dynamic resolution of tables and columns. | The available tables and fields are resolved dynamically based on the information the extractor can retrieve. | Applies to master data API only. | ||||||||
Static definition of tables. | The extractor stores a static list of tables which are always available for extraction. | Applies to all API besides master data. | ||||||||
Static definition of columns. | The extractor stores a static list of columns which are always avialable for extraction. | Applies to all API besides master data. | ||||||||
Customize metadata. | Allows the customization of the metadata via a custom JSON configuration to add tables and columns to the existing static definition. | |||||||||
Clear cache function. | Provides the option to manually clear the cache of metadata (tables and columns) to refreh it with the next request. |
Data processing and modification
The following data processing and modification features are supported based on the source system you're connecting to:
Feature | Feature Description | |||||||||
---|---|---|---|---|---|---|---|---|---|---|
Delta load as replace merge. | Provides an option to delete records of nested tables that are not relevant to the parent table anymore during the delta load. | |||||||||
Data return format. | Allows to specify the format of the returned data and therefore the amount specifically for Coupa.-
| |||||||||
Duplicate removal. | Duplicate records retrieved within the extraction are removed based on the defined primary key | |||||||||
Primary key propagation to nested tables of next level. | The primary key columns of a parent table are automatically propagated to its child tables of the next level. | |||||||||
Primary key propagation to nested tables of all levels. | The primary key columns of a parent table are automatically propagated to its child tables of all levels to ensure the tables can be joined correctly. | |||||||||
Ignore records with warnings. | Skips the records for which warnings are returned in the SAP Ariba extractions. | |||||||||
Debug. | Allows the enablement of a time-limited debug mode in the extraction settings to expose additional log messages. |