Scenario Description

• Installation of 

  D s product

   on a node in Microsoft Azure
• Installation of 

  D s item
  item databases

   on the same node
• Integration with a supported cluster for running jobs.
• Base storage layer and backend datastore of ADLS or WASB
• High availability or failover of the 

  D s node

   is not supported in Azure.
• High availability of cluster components is automatically managed by the HDI cluster. 
  • Auto-management does not apply to non-Hadoop clusters, such as Azure Databricks.

For more information on deployment scenarios, see Supported Deployment Scenarios for Azure.

Limitations

Deployment limitations

The following limitations apply to installations of 

• The application user credentials are used to access to the HDI cluster. Details are provided below.
• ADLS/Storage Blob access is only for the HDInsight cluster's primary storage. Additional storage accounts are not supported.
• HDFS must be set as the base storage layer of the 

  D s platform

  . Details are provided later.
  • S3 integration and AWS-based integrations such as Redshift are not supported.
• Use of HttpFS is not supported.
• Security features such as Kerberos and secure impersonation are not supported.

Product limitations

For general limitations on

Pre-requisities

Please acquire the following assets:

• Install Package: Acquire the installation package for your operating system.
  • License Key: As part of the installation package, you should receive a license key file. See License Key for details.
  • For more information, contact 

    D s support

    .
• Offline system dependencies: If you are completing the installation without Internet access, you must also acquire the offline versions of the system dependencies. See Install Dependencies without Internet Access.

Azure Desktop Requirements

• All desktop users must be able to connect to the instance through the enterprise infrastructure.

Azure Pre-requisites

Depending on which of the following Azure components you are deploying, additional pre-requisites and limitations may apply:

• Cluster:
  • Configure for HDInsight in the Configuration Guide
  • Configure for Azure Databricks in the Configuration Guide
• Storage:
  • Enable ADLS Access in the Configuration Guide
  • Enable WASB Access in the Configuration Guide
  • Enable ADLS Gen2 Access in the Configuration Guide
• Authentication:
  • Configure SSO for Azure AD in the Configuration Guide

Preparation

Before you begin, please verify that you have completed the following:

1. Read: Please read this entire document before you create the EMR cluster or install the 

   D s platform

   begin.
2. Cluster sizing: Before you begin, you should allocate sufficient resources for the cluster. For guidance, please contact your 

   D s item
   item representative

   .
3. Node: Review the system requirements for the node hosting the 

   D s platform

   . See System Requirements in the Planning Guide.
   

   1. The required set of ports must be enabled for listening. See System Ports in the Planning Guide.

   2. This node should be dedicated for 

      D s item
      item use

      .

4. Databases: 
   
   1. The platform utilizes a set of databases that must be accessed from the 

      D s node

      . Databases are installed as part of the workflow described later.