...
In the following sections, you can review short summaries of specific features and explore more detailed information on them.
Terms
| Term | Description |
|---|---|
| plan | A plan is a sequence of tasks that are executed |
| from the platform or on assets to which you have access. To orchestrate tasks, you build a plan. A plan can be scheduled for execution, triggered manually, or invoked via API. | |
| trigger | A task is executed based on a trigger. A trigger is a condition under which a task is executed. In many cases, the trigger for a task is based on the schedule for the plan. |
| task | A task is a unit of execution in the platform. |
| |
| snapshot | A snapshot of the plan is captured, and the plan is executed against this snapshot. For more information on snapshots, see "Plan execution" below. |
Task Types
...
The following types of tasks are available.
...
- flow task
...
- : An ad-hoc or scheduled execution of the transformations required to produce one or more selected outputs from a flow.
- HTTP task
...
- : A request submitted to a third-party server as part of a plan run.
- Slack task
...
- : Send a message with information about the plan run to a specified Slack channel.
- Delete task
...
- : Delete files and folders from backend data storage.
Limitations
- You cannot specify parameter overrides to be applied to plans specifically.
- Plans inherit parameter values from the objects referenced in the plan's tasks.
If overrides are applied to flow parameters inside of assets in a plan, those overrides are passed to the plan at the time of flow execution.
Tip task execution.
Basic Task
You create a plan and schedule it using the following basic task.
- Create the plan. A plan is the container for definition of the tasks, triggers, and other objects. See Plans Page.
- In Plan View, you specify the objects that are part of your plan. See Plan View Page.
- Schedule: The schedule defines the set of triggers that queue the plan for execution.
- Trigger: A trigger defines the schedule and frequency at which the plan is executed. A plan can have multiple triggers (e.g. monthly versus weekly executions).
- Task(s): Next, you specify the tasks that are executed in order.
Flow task: A flow task includes the specification of the flow to run and the outputs from the flow to generate.
Info NOTE: You can select the outputs from the recipe that you wish to generate. You do not need to generate all outputs.
Info NOTE: When a flow task is executed, the execution plan works back from the selected outputs to execute all of the recipes required to generate the output, including the upstream dependencies of those recipes.
- HTTP task: An HTTP task is a request issued when it is triggered from the application to a target endpoint. This request supports a variety of API methods. See Plan View for HTTP Tasks.
- Slack task: A Slack task is a message between the
and a specified Slack channel that is triggered within the plan. See Plan View for Slack Tasks.D s platform - Delete task: A Delete task deletes specific files or folders from backend storage. See Plan View for Delete Tasks.
- Continue building tasks in a sequence.
- Schedule: The schedule defines the set of triggers that queue the plan for execution.
- Click Run now.
- To track progress, click the Runs link.
- In the Run Details page, you can track the progress.
- The first task is executed and completes, before the second task is started.
- Individual tasks are executed as separate jobs, which you can track through the Job History page. See Job History Page.
- When the plan has completed, you can verify the results through the Job details page. See Job Details Page.
...
- These schedules are independent of schedules for individual flowsother asset types.
- You cannot create schedules for individual tasks.
...
When a plan is triggered for execution, a snapshot of the plan is taken. This snapshot is used to execute the plan. Tasks are executed in the sequence listed in Plan View.
Important notes:
| Info |
|---|
NOTE: Any subsequent changes to the flows, datasets, recipes, and outputs referenced in the plan's tasks can affect subsequent executions of the plan. For example, subsequent removal of a dataset in a flow referenced in a task can cause the task to fail to execute properly. |
At the flow level, you can define webhooks and email notifications that are triggered based on the successful generation of outputs. When you execute a plan containing an output with one of these messages, the message is triggered and delivered to stakeholders.
...
