Page tree

Trifacta SaaS



Contents:

   

Contents:


When you sign up to use  Trifacta®, you are provided a default storage environment which you can use to immediately get started using the product. A storage environment is used to store your data assets. 

Trifacta supports multiple storage environments, one of which is the default one. The default storage environment provides all of the storage capabilities of other storage environment, as well as storage for data assets generated by use of the product. In the following table, you can see the types of data assets that are stored in each type of storage environment:

Asset TypeDescriptionDefault StorageNon-Default Storage
imported datasets

When you upload data to the product, it is stored in the default storage environment. From these uploaded assets, you create imported datasets, which are sources of data for your transformation recipes.

You can also import data that is stored in other storage environments.

YesYes
job resultsWhen you run a job to transform your data, the results of the job execution are stored in a storage environment.YesYes
samples

When you create transformation recipes, you are working on a sample of the source data.

  • When you first open a recipe, an initial sample of the recipe is created for you and stored on the default storage environment.
  • As needed, you can start a job to create a new sample of your data. Ad-hoc samples are also stored on the default storage environment.
  • For more information, see Overview of Sampling.
YesNo
temporary files

During ingestion of data and job execution, Trifacta requires storage space in the default storage environment to store temporary files.

YesNo

For more information on these assets, see Glossary.

Storage Environment Options

You can use either of the following storage environments as the default or secondary storage environment.

  • When the product is first launched, TFS is the default storage environment. You must configure access to your S3 buckets and assets.
  • One of the following must be set as the default storage environment.

    Tip: You can switch between TFS and S3 as your default storage environment at any time without disruption to service or loss of data.

Storage EnvironmentDescription

TFS

Short for Trifacta File Storage, this S3-backed storage environment is managed by Trifacta and requires no additional configuration to manage. It is available as soon as your launch the product for the first time. Details are below.

S3

Your S3 buckets and their assets.

NOTE: To access your S3 assets, you must provide authentication credentials, policies, and other configuration information to the Trifacta application. Additional information is provided below.

TFS Storage Environment

When  Trifacta is first launched, TFS is  defined as the default storage environment. This storage environment provides storage for the above data asset types. Trifacta File Storage  is backed by AWS S3 buckets hosted by Trifacta and secured by IAM policies.

Using  TFS  is very similar to navigating S3 buckets to find and select assets to import or to locate job results that you have published. For more information, see  Using TFS .

Enable Access to S3 and AWS Resources

For more information, see Enable Access to S3 and AWS Resources.

Add S3 as a Storage Environment

When TFS is the default storage environment, you can add S3 as a secondary storage environment.

NOTE: Before you begin, please verify that you have acquired the AWS Configuration Information above.


Please complete the following.

Steps:

  1. Login as a workspace administrator.
  2. You apply this change through the Workspace Settings Page. For more information, see Platform Configuration Methods.
  3. Locate the following setting and set it to Enabled:

    Enable S3 connectivity
  4. Configure the workspace AWS authentication. In the Trifacta application, select User menu > Admin console > AWS Settings. See Configure Your Access to S3.
    1. If you have enabled per-user authentication to AWS, individual users must configure their own AWS authentication. See Storage Config Page

Use S3 as Default Storage Environment

You can configure S3 to be the default storage environment, instead of TFS.

NOTE: If you are switching the default storage environment, any data that was written to another default storage environment is still available through the application, as long as you do not disable access to the storage environment. There should be no interruption of service or loss of access to your data.


NOTE: Before you begin, please verify that you have acquired the AWS Configuration Information above.

Please complete the following.

Steps:

  1. You apply this change through the Workspace Settings Page. For more information, see Platform Configuration Methods.
  2. If you have not done so already, enable access to S3: 

    1. Locate the following setting and verify that it is set to Enabled:

      Enable S3 connectivity
    2. Configure the workspace AWS authentication. In the  Trifacta application , select  User menu > Admin console > AWS Settings . See  Configure Your Access to S3 .
      1. If you have enabled per-user authentication to AWS, individual users must configure their own AWS authentication. See Storage Config Page
  3. Locate the following setting and set it to S3:

    Default storage environment

Disable TFS

If you wish to disable all access to TFS, please do the following:

Steps:

  1. You apply this change through the Workspace Settings Page. For more information, see Platform Configuration Methods.
  2. Enable S3 as the default storage environment. See "Use s3 as Default Storage Environment."
  3. Locate the following setting and set it to Disabled:

    Trifacta File Storage


This page has no comments.