As needed, you can schedule the execution of recipes in your flows on a recurring basis. For example, if the source file of your flow is updated outside of the application on a weekly basis, you can define a schedule to execute the recipe associated with the related imported dataset after the data has been refreshed. When the scheduled job successfully executes, you can collect the wrangled output in the specified output location, where it is available in the published form that you have specified.
To schedule a job, you must create the following configuration objects:
Define a schedule - For each flow you can define a schedule. A schedule specifies one or more recurring times when scheduled jobs for the flow are executed. For example, in a single schedule, you can specify daily execution times for incremental updates and monthly execution times for rollups.
Tip: The scheduler supports a modified form of cron job syntax. For more information, see cron Schedule Syntax Reference. |
NOTE: Since scheduled destinations are re-populated with each scheduled execution, you must determine how you wish to manage the data that is published to each location. Data management should be done outside of |
Tip: When a schedule is executed, all outputs in a flow are generated, even if they are unused. For better performance on larger flows, you can create a separate flow that contains only the references back to the objects in the source flow that you wish to have scheduled. As an additional benefit, this separation keeps development and scheduled execution in separate flows. |
Schedules and scheduled destinations are defined through Flow View.
Tip: You can create schedules for datasets with parameters and apply overrides through Flow View at runtime. See Flow View Page. |
For more information, see Schedule a Job.
You can monitor a scheduled job like any other job in the application. See Jobs Page.
See Configure Scheduling.
Automation of scheduled jobs can be managed outside of the user interface using the following methods.
You can use an external scheduler to manage the repeated executions of a specified job. See CLI Example - Parameterize Job Runs.
Not supported in this release.