Earlier Releases of Cloud Dataprep

Introducing Dataprep Premium by Trifacta and Dataprep Standard by Trifacta: You can now upgrade your existing Dataprep by Trifacta projects to unlock advanced features, such as broader API access and relational connectivity. To see the full set of new capabilities and use cases, see https://www.trifacta.com/products/pricing/cloud-dataprep/.

• These two product tiers are available through the Google Cloud Platform Marketplace. See https://console.cloud.google.com/marketplace/product/endpoints/cloud-dataprep-editions-v2.
  • Dataprep Premium by Trifacta enables Fine Grained Data Access Control, which requires additional permissions within the project. For more information on these permissions, see Required Dataprep User Permissions.
  • For more information, see Getting Started with Cloud Dataprep.
• Important: All existing Dataprep by Trifacta projects are unchanged. You can upgrade individual projects through the GCP Marketplace to unlock the new functionality.

Relational connectivity: Connect to relational sources to import data and, where supported, write results. 

• Feature Availability: This feature is available in Dataprep Premium by Trifacta only.
• The following relational connections are supported:
  • Create Oracle Connections
  • Create PostgreSQL Connections
  • Create SQL Server Connections
  • Create Salesforce Connections
• For more information, see Connect.

Advanced Dataflow execution options: Specify additional job execution options at the project level or for individual jobs. 

• Feature Availability: This feature is available in Dataprep Premium by Trifacta® only.
• Assign scaling algorithms for managing Google Compute Engine instances or define minimum and maximum workers to use.
• Specify the service account and any billing labels to apply to your jobs.
• For more information:
  • Project-level settings: see Execution Settings Page.
  • Individual job executions: see Dataflow Execution Settings.

Introducing plans: A plan is a sequence of tasks on one or more flows that can be scheduled.

• Feature Availability: This feature is available in Dataprep Premium by Trifacta only.
• NOTE: In this release, the only type of task that is supported is Run Flow.

• For more information on plans, see Plans Page.

• For more information on orchestration in general, see Overview of Operationalization.

Dataflow execution in non-local VPC: You can now execute your Dataflow jobs on a non-local or shared virtual private network (VPC).

• NOTE: To accommodate a wider range of shared VPCs configuration, subnetworks must be specified by full URL. See Changes below.
• Project owners can set these execution options for the entire project. See Execution Settings Page.

Flow parameters: Create flow parameters that you can reference in the recipes of your flow. 

• NOTE: For this release, flow parameters can be applied into your recipes only.
• As needed, you can apply overrides to the parameters in your flow or to downstream flows. 
• NOTE: Flow parameters do not apply to datasets or output objects, which have their own parameters. However, if you specify an override at the flow level, any parameters within the flow that use the same name receive the override value, including output object parameters and datasets with parameters.
• See Manage Parameters Dialog.
• For more information on parameters, see Overview of Parameterization.

Introducing new Flow View: The Flow View page has been redesigned to improve the user experience and overall productivity. 

• Enhancements include:
  • Drag and drop to reposition objects on the Flow View canvas, and zoom in and out to focus on areas of development.
  • Perform joins and unions between objects on the Flow View canvas. 
  • Annotate the canvas with notes.
• You can toggle between new and classic views through the context menu in the corner of Flow View. See Flow View Page.

Redesigned Settings and Help menus: See Home Page.

• User settings are now modified through Preferences. See Preferences Page.

Report issue: If you are experiencing an issue with Dataprep by Trifacta, you can gather useful information from the application to deliver to Trifacta Support.

• From the Help menu, select Report issue.

Transformer page:

• Join steps are now created in a larger window for more workspace. See Join Window.
• New column selection UI simplifies choosing columns in your transformations. See Transform Builder.

Transformer page performance:

• Improved performance when loading the Transformer page and when navigating between the Flow View and Transformer pages.

• Faster and improved method of surfacing transform suggestions based on machine learning.

New functions:

• New aggregation functions for Datetime values:
  • MINDATE Function
  • MAXDATE Function
  • MODEDATE Function
• New parsing by data type functions:
  • PARSEBOOL Function
  • PARSEFLOAT Function
  • PARSEINT Function
  • PARSEDATE Function
• New functions for calculating working days between two valid dates:
  • NETWORKDAYS Function
  • NETWORKDAYSINTL Function
  • WORKDAY Function
  • WORKDAYINTL Function
• New time zone conversion functions:
  • CONVERTFROMUTC Function
  • CONVERTTOUTC Function
  • CONVERTTIMEZONE Function
• New statistical functions:
  • MEDIAN Function
  • PERCENTILE Function
  • QUARTILE Function
  • CORREL Function
  • COVAR Function
  • COVARSAMP Function
• Ignore case parameter added to string functions:
  • STARTSWITH Function
  • ENDSWITH Function
  • EXACT Function
  • MATCHES Function
  • STRINGGREATERTHAN Function
  • STRINGGREATERTHANEQUAL Function
  • STRINGLESSTHAN Function
  • STRINGLESSTHANEQUAL Function
  • SUBSTITUTE Function

Advanced Dataflow Settings:

• Feature Availability: This feature is available in Dataprep Premium by Trifacta only.
• Project admins can apply advanced dataflow execution settings to all jobs in the project. See Execution Settings Page.
• These settings can be overridden with values applied to individual jobs or output objects. See Dataflow Execution Settings.
• Via jobGroup API: See API Workflow - Run Job .

• Via outputObject API: See API Workflow - Manage Outputs.

Macros:

• Support for export and import of macros. See Macros Page.
  • For more information on macros, see Overview of Macros.
• Download and use macros available through the Wrangle Exchange. See https://www.trifacta.com/blog/crowdsourcing-macros-trifacta-wrangle-exchange/.

Improved RapidTarget: Improved matching logic and performance when matching columns through RapidTarget.

• Align column based on the data contained in them, in addition to column name. 
• This feature is enabled by default. For more information, see Overview of RapidTarget.

Improved Date/Time format selection: See Choose Datetime Format Dialog.

• Tip: Datetime formats in card suggestions now factor in the user's locale settings for greater relevance.

APIs: Apply overrides at time of job execution via API.

• When you are running a job, you can override the default publication settings for the job using overrides in the request. For more information, see API Workflow - Run Job.

New functions:

• Trigonometry functions:
  • SIN Function
  • COS Function
  • TAN Function
  • Cotangent function (see TAN function)
  • Secant function (see COS function)
  • Cosecant function (see SIN function)
  • ASIN Function
  • ACOS Function
  • ATAN Function
  • Arccotangent function (see ATAN Function)
  • Arcsecant function (see ACOS Function)
  • Arccosecant function (see ASIN Function)
  • SINH Function
  • COSH Function
  • TANH Function
  • ASINH Function
  • ACOSH Function
  • ATANH Function
• Statistical Functions:
  • STDEVSAMP Function
  • STDEVSAMPIF Function
  • ROLLINGSTDEVSAMP Function
  • VARSAMP Function
  • VARSAMPIF Function
  • ROLLINGVARSAMP Function

Introducing APIs: Manage job execution via API.

• Dataprep by Trifacta now supports API endpoints for programmatic execution and monitoring of Trifacta jobs. Beginning in this release, you can use token-based security to manage the launching and execution of Dataprep by Trifacta jobs. For more information, see API Reference.
• This API should be used as a replacement for Dataflow templates for programmatic invocation of Trifacta jobs. In addition, this feature includes support for dynamic functions and input & output destinations.
• NOTE: Dataflow templates generated by Dataprep by Trifacta are still supported but are no longer recommended for use.

Introducing Transformation by Example: Transform by example output values for a column of values. See Transformation by Example Page.

• For an overview of this feature, see Overview of TBE.

New functions:

• PARSEDATE Function
• DENSERANK Function
• RANK Function