Page tree

Trifacta Dataprep


Contents:

On April 28, 2021, Google is changing the required permissions for attaching IAM roles to service accounts. If you are using IAM roles for your Google service accounts, please see Changes to User Management.

   

Contents:


Feature Availability: This feature is available in Cloud Dataprep Premium by TRIFACTA® INC. only.

In Plan View, you design your plan, which includes the building and sequencing of tasks and the triggers that execute your sequence of tasks.


NOTE: Access to this page in the application and privileges on its related objects is governed by roles in your workspace. For more information, please contact your workspace administrator.


Figure: Plan View Page

The main panel is the plan canvas, where you build your plans.

On the right side is the context panel. Depending on what you select in the plan canvas, a different set of context options is displayed.

Tip: To rename the plan, click the plan name in the top bar.

Zoom Options:

You can zoom the plan canvas to display areas of interest in the plan graph. 

The zoom control options are available at the right side of the canvas. The following are the available zoom options:

Tip: You can use the keyboard shortcuts listed in the zoom options menu to make quick adjustments to the zoom level.

  • Zoom in: Zoom in 10% on the canvas to focus on greater detail.
  • Zoom out: Zoom out 10% from the canvas to see more of it.
  • Zoom to fit: Change the zoom level to fit all of the objects of your plan onto the screen.
  • 25%, 50%, or 100%: Change the zoom level to one of the preset levels.

Limitations: By default, the plan view page always opens in Zoom to fit option and it does not remember the previous zoom and position.

Actions:

  • Run now: Run the plan now. You can track progress of your plan run.

    Tip: You can apply overrides to flow parameters through the Parameters tab. See Plan View for Flow Tasks.

    See Plan Runs Page.

Menu options:

  • Share: Share the plan with other users. See Share a Plan.
  • Rename: Modify the name and description for your plan.
  • Schedule: Create or edit the plan schedule with one or more triggers through the right context panel. See "View for Tasks."
  • Parameters: You can apply overrides to the recipe parameters for your plan tasks during plan job runs. See Manage Parameters Dialog.
  • Email notifications: Send email notifications on the plan runs. See Manage Plan Notifications Dialog.
  • Export: Export the plan from  Cloud Dataprep by TRIFACTA INC.. See Export Plan.
  • Delete: Delete your plan. 

Runs: The Runs link tracks the current total number of runs that have been queued or executed for this plan. Click this link to track progress on your plan run. See "Run Details" below.

Workflow

For more information, see Create a Plan.

View for Triggers

To create a trigger, you specify the time and frequency that the plan is to be executed:

Figure: Create plan trigger

  • Timezone: Select the timezone for the time that you are specifying in the trigger's schedule. 
  • Frequency: Specify how frequently the plan is triggered:
    • On: You can specify multiple entries to trigger the plan more frequently.
    • cron: Set the schedule according to cron syntax. 
  • To add another trigger, click Add another trigger.
  • To save your changes, click Save.

Figure: Saved trigger

  • To disable the trigger, click the slider.

    NOTE: If you disable a trigger, no new scheduled executions of the tasks in the plan occur. You can still manually trigger plan runs.

  • To make changes to the trigger, click Edit.

View for Tasks

When you create or select a task, you can modify its settings through the context panel on the right.

Tip: To rename the flow task or HTTP, click the corresponding task name in the context panel.

Task context menu options: 

  • View Flow: Open the flow. See Flow View Page.
  • Edit name: Modify the name of the task.
  • Delete: Delete the task from your plan.

Task types

Run Details

You can review the details of individual executions of your plan. Click the Runs link in the upper-right corner.

Figure: Run details

The latest plan run is displayed. You can review the progress of individual tasks throughout the plan run.

NOTE: When a plan run begins, a snapshot is taken of the plan. Subsequent changes to the underlying flows could impact the outcome of the flow tasks when they are later executed during the plan run.

  • You can select individual triggers and tasks to review details of the plan run for that object in the context panel. 
  • To see other runs for the plan, use the angle brackets next to the timestamp at the top of the screen. 

You can track all of the runs across all of your plans. See Plan Runs Page.

Task Execution Rule

You can gate the execution of a task based on the completion status of its previous task. Click the line connecting the two tasks and select one of the following options:

  • On success: Runs if the previous task in the node is successful.
  • On failure: Runs if the previous task in the node failed.
  • On execution (any status): Runs the task in the node irrespective of the previous task's status (success or failure).

For more information, see Create a Plan.

Parallel Tasks

You can can execute one or more tasks in parallel by clicking the plus node icon and selecting one of the following options:

  • Add a parallel node: Adds a parallel node to the existing node.
  • Add a node: Adds a node at the bottom of the existing node.

NOTE: Nodes added in a sequence are separated by a plus node. A node added in parallel has two plus nodes separating it from the parent node; one for adding nodes in parallel and other for adding a node in sequence.

The following icons indicate the results of the execution of a task:

IconTask Status

Task successful

Task failed

Task skipped. Task was not executed due to unmet conditions.

Task canceled by user


Task in progress

Task pending

For more information, see Create a Plan.

Cancel Plan Run

To cancel a plan that is currently running, please do the following: 

  1. In Plan View, click the Runs (x) link.
  2. In the Run Details page, click Cancel plan run.

This page has no comments.