Page tree

   


Contents:


After you have created your recipe and are ready to apply your transformation steps to your source data, you can run a job to generate the results for review and downstream consumption.

Run Your First Job

To run your first job:

  • In the Transformer page, click Run.
  • In Flow View, you must create an output object first.
    • Click your recipe, and select Create Output to run.
    • Then, select the output. In the Jobs tab on the right side, click Run.

For more information, see Run a Job.

Create Output

Every job requires an output object, which defines the format, location, and other settings of the output file(s) or table(s) that are produced when the job completes.

Tip: When you run the first job on a recipe, a default output object is created for you to produce a CSV in your default output location.

You can modify or define outputs to meet your pipeline requirements. For more information, see Create an Output.

Visual Profiling

When you define your job, you can choose to generate a visual profile, which provides visual information on the quality of your results, including statistical information about each column. 

Tip: Visual profiles can be useful for troubleshooting wrangling issues and for summarizing your datasets for other analysis.

For more information, see Visual Profiling.

Export Results

During job execution, you can monitor progress on the job through the Job Details page. When the job is complete, your results are ready in the designated output location and format.

As needed, you can download results for offline use or use them to create a new dataset.

For more information, see Export Results.

Schedule Jobs

Feature Availability: This feature may not be available in all product editions.

In many cases, the same job needs to be executed on a periodic basis. For example, your source dataset may be updated on a weekly basis to include a fresh set of transactions. As needed, you can schedule the execution of your jobs to refresh the output data. For more information, see Schedule Jobs.

This page has no comments.