D toc |
---|
Please complete the following steps in the listed order to configure your installed instance of the
D s platform | ||
---|---|---|
|
Prerequisites
Deploy running environment cluster and
.D s node Info NOTE: The running environment cluster can be deployed as part of the installation process. You can also integrate the platform with a pre-existing cluster. Details are below.
- Install
on the node.D s platform
For more information, see Install for Azure.
Excerpt | ||||||||||||||||||||||||||||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Configure AzureCreate registered applicationYou must create an Azure Active Directory (AAD) application and grant it the desired access permissions, such as read/write access to resources and read/write access to the Azure Key Vault secrets.
This service principal is used by the
After you have registered, acquire the following information:
These properties are applied later in the configuration process. Configure the Platform
|
D s platform |
---|
Configure base storage layer
For Azure installations, you can set your base storage layer to be HDFS or WASB.
Info |
---|
NOTE: The base storage layer must be set after installation. After it has been configured, it cannot be modified. |
Azure storage | webapp.storageProtocol setting |
---|---|
WASB | wasbs |
ADLS Gen2 | abfss |
ADLS Gen1 | adl |
Configure for Key Vault
For authentication purposes, the
D s platform |
---|
Configure for SSO
If needed, you can integrate the
D s platform |
---|
Configure for ADLS Gen2
Enable read-only or read-write access to ADLS Gen2. For more information, see ADLS Gen2 Access.
Configure for ADLS Gen1
Enable read-only or read-write access to ADLS Gen1. For more information, see ADLS Gen1 Access.
Configure for WASB
Enable read-only or read-write access to WASB. For more information on integrating with WASB, see WASB Access.
Configure for Azure Gov Cloud
To enable use of the Azure Gov Cloud, please perform the following configuration steps.
Info |
---|
NOTE: Managed Identities is not supported for Azure Gov Cloud. |
Steps:
D s config Locate the following parameter and set it to
US_GOV
:Code Block "azure.environment": "US_GOV",
Save your changes and restart the platform.
Configure relational connections
If you are integrating
D s product |
---|
Create encryption key file
An encryption key file must be created on the
D s node |
---|
Create Azure SQL Database connection
For more information, see Azure SQL Database Connections.
Create Azure SQL DW connection
For more information, see Microsoft SQL Data Warehouse Connections.
Testing
- Load a dataset from the cluster.
- Perform a few simple steps on the dataset.
- Click Run in the Transformer page.
- When specifying the job:
- Click the Profile Results checkbox.
- Select Spark.
- When the job completes, verify that the results have been written to the appropriate location.
D s also | ||||
---|---|---|---|---|
|