Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Excerpt

Scenario Description

Info

NOTE: All hardware in use for supporting the platform is maintained within the enterprise infrastructure on Azure.

  • Installation of 
    D s product
     on a node in Microsoft Azure
  • Installation of 
    D s item
    itemdatabases
     on the same node
  • Integration with a supported cluster for running jobs.
  • Base storage layer and backend datastore of ADLS Gen1, ADLS Gen2, or WASB
  • High availability or failover of the 
    D s node
     is not supported in Azure.
  • High availability of cluster components is automatically managed by the HDI cluster. 
    • Auto-management does not apply to non-Hadoop clusters, such as Azure Databricks.

For more information on deployment scenarios, see Supported Deployment Scenarios for Azure.

Limitations

Deployment limitations

The following limitations apply to installations of 

D s product
productee
 on Azure:

Info

NOTE: If you are using Azure Databricks as a datasource, please verify that openJDKv1.8.0_242 or earlier is installed on the

D s node
. Java 8 is required. If necessary, downgrade the Java version and restart the platform. There is a known issue with TLS v1.3.


  • The application user credentials are used to access to the HDI cluster. Details are provided below.
  • ADLS Gen1/Storage Blob access is only for the HDInsight cluster's primary storage. Additional storage accounts are not supported.
  • HDFS must be set as the base storage layer of the 
    D s platform
    . Details are provided later.
    • S3 integration and AWS-based integrations such as Redshift are not supported.
  • Use of HttpFS is not supported.
  • Security features such as Kerberos and secure impersonation are not supported.

Product limitations

For general limitations on

D s product
, see Product Limitations.

Pre-requisities

Please acquire the following assets:

  • Install Package: Acquire the installation package for your operating system.
    • License Key: As part of the installation package, you should receive a license key file. See License Key for details.
    • For more information, contact 
      D s support
      .
  • Offline system dependencies: If you are completing the installation without Internet access, you must also acquire the offline versions of the system dependencies. See Install Dependencies without Internet Access.

Azure Desktop Requirements

  • All desktop users must be able to connect to the instance through the enterprise infrastructure.

Azure Pre-requisites

Depending on which of the following Azure components you are deploying, additional pre-requisites and limitations may apply:

Preparation

Before you begin, please verify that you have completed the following:

  1. Read: Please read this entire document before you create the EMR cluster or install the 
    D s platform
    begin.
  2. Cluster sizing: Before you begin, you should allocate sufficient resources for the cluster. For guidance, please contact your 
    D s item
    itemrepresentative
    .
  3. Node: Review the system requirements for the node hosting the 
    D s platform
    . See System Requirements in the Planning Guide.
    1. The required set of ports must be enabled for listening. See System Ports in the Planning Guide.

    2. This node should be dedicated for 

      D s item
      itemuse
      .

  4. Databases: 
    1. The platform utilizes a set of databases that must be accessed from the 
      D s node
      . Databases are installed as part of the workflow described later.

...

  1. Create the following directories, which are specified by parameter in the platform. 

    Default HDFS pathPlatform configuration property

    /user/trifacta

     


    /trifacta
     

    /trifacta/dictionarieshdfs.pathsConfig.dictionaries
    /trifacta/librarieshdfs.pathsConfig.libraries
    /trifacta/queryResultshdfs.pathsConfig.batchResults
    /trifacta/tempfileshdfs.pathsConfig.tempFiles
    /trifacta/uploadshdfs.pathsConfig.fileUpload
    /trifacta/.datasourceCachehdfs.pathsConfig.globalDatasourceCache


  2. Change the ownership of the above directories to trifacta:trifacta or the corresponding values for the S3 user in your environment.

...

Cluster TypeSupported O/S for VMNotes
HDInsightUbuntu only

D s platform
must be installed on an edge node of the HDInsight cluster.

Azure DatabricksCentOS and Ubuntu 
  • For more information, see System Requirements in the Planning Guide.
  • A set of ports must be opened on the VM for the platform. For more information, see System Ports in the Planning Guide.
  • When you configure the platform to integrate with the cluster, you must acquire some information about the cluster resources. For more information on the set of information to collect, see Product Support Matrix in the Planning Guide.

...