Running transformations
After publishing custom transformations to the OCPM Data Pool, run them to create objects and events from your custom object types and custom event types, or to update existing objects and events to which you’ve added new attributes and relationships.
Celonis stores custom transformations in the data job test:ocpm-data-job when you publish to the development environment, and in ocpm-data-job when you publish to the production environment. These data jobs are in the global scope for the OCPM Data Pool. The jobs contain the Celonis-supplied transformations as well as your custom transformations, so you can use these instructions to run or re-run the supplied transformations if you didn’t run them already.
If you have any problems, check the solutions in Troubleshooting transformations.
From the Celonis navigation bar, select Data > Objects and Events.
Select Dashboard in the top navigation bar to go to the dashboard.
Select OCPM Data Pool to go to the data pool.
You can also select Data > Data Integration from the Celonis navigation bar and pick the OCPM Data Pool from the list of data pools.
In the OCPM Data Pool, click the Data Jobs area.
Select test:ocpm-data-job to create objects and events in the development environment, or ocpm-data-job to create objects and events in the production environment.
In the list of transformations, select the name of any transformation if you want to review its details.
When you’re ready to run your transformations, click Execute Data Job. In the confirmation window, you can select just a subset of the transformations if you want to.
Tip
If there's a Celonis object type or event type that you don’t need, or don’t have data for, or are building with data from a set of transformations for another source system, you can disable the transformation for it in the Objects and Events environment. If you disable a transformation that you previously ran, the data for that object type or event type is removed from the table when you run the data job.
Click Execute Selection to run the selected transformations - if you don’t make a selection, they’ll all run.
In the Data Jobs area in the OCPM Data Pool, the data job displays the status and execution time so far, and there’s a button if you want to stop the job running.
You can monitor the status of the running transformations in the Logs tab for the data job. You can also see the status of the last transformation run in the Transformations page for each object type and event type in the Objects and Events UI. When the transformations have finished running, the status should show as "Successful".
When you're ready to run your data jobs regularly, set up schedules for them. Scheduling data jobs for object-centric process mining tells you how.
The transformations populate the tables in the Celonis database in the OCPM Data Pool with your business data to create objects and events. When you run test:ocpm-data-job, you’ll get a test copy in tables with the prefix "t". When you run ocpm-data-job, you’ll get the objects and events in your production environment.
To view your objects and events and analyze your business processes with them, see Using objects and events for process mining. To use custom object types and custom event types, you’ll need to create custom perspectives following the instructions in Creating custom perspectives and event logs.
Scheduling data jobs for object-centric process mining
When you've published your object-centric data model to the data pool, set up a schedule to run your data pipeline regularly. You'll need schedules for these data jobs:
ocpm-extraction-job, which extracts data from your source system. Your extraction package’s data job might have a different name. If you have multiple source systems, schedule the extractions for all of them.
ocpm-data-job, which runs the transformations to create objects and events in your production environment.
Any other data jobs that you’re using in your production environment for object-centric process mining.
The data job test:ocpm-data-job runs the transformations to create objects and events in your development environment. You might prefer to run this manually as you need to - the instructions are at Running transformations. You can set up a schedule if you prefer, for example to run it overnight.
If you're using only the OCPM Data Pool, set up the schedules in there. If you're using the feature that gives you object-centric data models in all your data pools, set them up in each data pool where you're using them. In the data pool, go to Schedules > Add Schedule and follow the instructions in Scheduling the execution of data jobs.
You can set up schedules to run the transformations for just one perspective at a time (or more than one if you want). Perspective scheduling can be done for Celonis catalog perspectives and custom perspectives.
Note
Perspective scheduling is currently in Limited Availability - if you'd like to try it out now, open a Support ticket to request it.
When you run the OCPM data job through a schedule where you've selected perspectives, we'll identify all the objects and events that are part of those perspectives. Then we’ll run only the transformations that are needed to create those objects and events from your source system data. If you have modeled several processes in the same data pool, you can use this method to limit the time taken and the potential for incomplete runs.
When queuing of data jobs is enabled, if an instance of a data job is running and another instance of the same data job is scheduled to start, the second instance will be queued until the first finishes. If queuing of data jobs isn't enabled, the second instance will be skipped.
Here's how to set up schedules for perspectives:
In the data pool where your object-centric data model is, add as many schedules as you want for ocpm-data-job or the development version test:ocpm-data-job.
In each schedule under Selected Data Jobs, go to the context menu (the three vertical dots) for your OCPM data job, and select the Configure Perspectives option.
Click Perspectives to display the list of perspectives that are enabled in your OCPM data job. Check the box for one or more perspectives that you want to load together and click Save.
To verify the results, you can run the schedule by clicking the Execute button at the top right, and confirming that you want to execute the OCPM data job.
Currently, while the feature is in Limited Availability, you'll also need to enable queuing of data jobs manually for every schedule where you've selected perspectives. To do this, go to the context menu (the three vertical dots) for each schedule and select Execution Settings, set the slider on, and click Save. When the feature enters General Availability, queuing of data jobs will become the default behavior for all schedules in the OCPM Data Pool.
Tip
Queuing of data jobs lets Data Integration schedule multiple instances of the same data job. It’s available in every data pool, not just the OCPM Data Pool. So you can activate it for other data jobs if you want to - including case-centric data jobs. In every data pool that doesn't have object-centric data models active, queuing of data jobs will be off by default. In every data pool that does, it will be on by default.