This section describes how to run a deployment using the APIs available in Trifacta® Wrangler Enterprise.
- A deployment is a packaging mechanism for versioning your production-level flows.
- Deployments are created and managed through a separate interface.
- For more information, see Overview of Deployment Manager.
A note about API URLs: In the listed examples, URLs are referenced in the following manner:
In your product, these map references map to the following: For more information, see API Reference.
A note about API URLs:
In the listed examples, URLs are referenced in the following manner:
In your product, these map references map to the following:
For more information, see API Reference.
Before you begin, you should verify the following:
Get authentication credentials. As part of each request, you must pass in authentication credentials to the Trifacta platform.
Tip: The recommended method is to use an access token, which can be generated from the Trifacta application. For more information, see Access Tokens Page.
For more information, see API Authentication.
- Develop your flow. Before you deploy a flow through the Deployment Manager, you should build and test your flow in a development environment. See API Workflow - Develop a Flow.
- Deploy your flow. After you have developed a flow, you can deploy it. See API Workflow - Deploy a Flow.
Acquire deployment identifier. In Deployment Manager, acquire the numeric value for the deployment. See Deployment Manager Page.
Step - Run Deployment
Through the APIs, you can run a deployment. When a deployment is executed:
- All of the recipes that are included in the active release of the deployment are executed.
- All default values for outputs are applied.
Tip: When running a deployment, you cannot apply overrides through the API request. However, overrides can be specified through a different mechanism described later.
In the following example, the deployment identifier is
201 response code is returned, then the deployment job has been queued for execution.
Tip: Retain the
id value in the response. In the above,
961247 is the internal identifier for the job group for the job. You will need this value to check on your job status.
For more information, see API Workflow - Deploy a Flow.
Checkpoint: You have queued your deployment job for execution.
Step - Monitoring Your Deployment Job
You can monitor the status of your deploy job through the following endpoint using the
id value that was returned in the previous step:
For more information, see API Workflow - Run Job.
Step - Run Deployment with Overrides
When you run a deployment, you cannot apply overrides to the request. However, you can complete the following steps to apply overrides when you execute the jobs within the active release. In this workflow, you run jobs on the specific recipes of the active deployment, applying overrides as needed.
Suppose you are running the jobs for deployment id
2, and you want to apply some overrides.
NOTE: A deployment can trigger several different jobs within a single flow. In the following example, it is assumed that there is only one output.
Acquire the active outputs for the deployment
The first step is to acquire all of the active outputs for the deployment.
in the above response:
flowNodeIdvalue corresponds to the recipe (
wrangledDataset) identifier that you wish to modify.
outputObjectIdvalue corresponds to the output object that is produced by default from the recipe.
Acquire output object information
The next step is to review the output object to determine what needs to be overridden. Since you are overriding a file-based publication, you can query directly for the
writeSettings objects associated with the output object:
Run deployment with overrides
Now that you have access to the outputs generated by the deployment, you decide to override the following for each file:
- Remove the year information at the end of the filename
- Store in a separate folder called
- Wipe the table and reload it each time (
- Disable profiling
From the activeOutputs endpoint, you retrieved the flowNodeId (
Checkpoint: Your job with overrides has been queued for execution.
You can use the job identifier (
4) to monitor the job status.
This page has no comments.