...
| Info |
|---|
NOTE: Depending on your version of the following cluster platforms, specific versions of Spark may be required. |
Hadoop on-premises
| Cluster type | Supported Versions | Notes, Limitations and Additional Doc | ||
|---|---|---|---|---|
| Cloudera |
|
Details: Supported Deployment Scenarios for Cloudera in the Install Guide | ||
| Hortonworks |
|
Details: Supported Deployment Scenarios for Hortonworks in the Install Guide |
Hadoop cloud
| Cluster type | Supported Versions | Notes, Limitations and Additional Doc | ||
|---|---|---|---|---|
| Cloudera Data Platform |
|
Details: Supported Deployment Scenarios for Cloudera in the Install Guide |
AWS
| Cluster type | Supported Versions | Notes, Limitations and Additional Doc | ||
|---|---|---|---|---|
| EMR |
| EMR 6.2.1 is supported only with use of Spark 3.0.1.
Details: Configure for EMR in the Configuration Guide. | ||
| EMR |
| EMR 5.28.0 is not supported, due to Spark compatibility issues. Please use 5.28.1 or later.
Details: Configure for EMR in the Configuration Guide | ||
| AWS Databricks |
| Details: Configure for AWS Databricks in the Configuration Guide |
For more information, see AWS Integrations below.
Azure
| Cluster type | Supported Versions | Notes, Limitations and Additional Doc | |||||
|---|---|---|---|---|---|---|---|
| Azure Databricks |
|
Details: Configure for Azure Databricks in the Configuration Guide |
For more information, see Azure Integrations below.
...
The platform must be configured to integrate with a base storage layer. This layer is used for storage of uploads, samples, and job results. See Set Base Storage Layer in the Configuration Guide.
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| HDFS | Default | Details: Configure for Hadoop in the Configuration Guide |
| S3 | n/a | Details: S3 Access in the Configuration Guide |
SSO Authentication methods
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| AD-LDAP | n/a | Details: Configure SSO for AD-LDAP in the Configuration Guide |
| SAML | 2.0 | Details: Configure SSO for SAML in the Configuration Guide |
Hadoop Integrations
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| Hive |
| Additional support requirements vary with the version of Hive. Details: Configure for Hive in the Configuration Guide |
| KMS | Default | Additional configuration is required depending on your deployed distribution of Hadoop. Details: Configure for KMS in the Configuration Guide |
| Sentry | Default | |
| Ranger | Default |
AWS Integrations
Base storage layer options
Details: Supported Deployment Scenarios for AWS in the Install Guide
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| S3 | n/a | |
| HDFS | Default |
SSO Authentication methods
Details: Configure for AWS in the Configuration Guide
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| AWS Key-Secret | n/a | |
| EC2 instance roles | n/a | |
| IAM roles | n/a |
Azure Integrations
Base storage layer options
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| ADLS Gen2 | n/a | Details: ADLS Gen2 Access in the Configuration Guide |
| ADLS Gen1 | n/a | Details: ADLS Gen1 Access in the Configuration Guide |
| WASBS | n/a | Details: WASB Access in the Configuration Guide |
SSO Authentication methods
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| Azure AD | n/a | Details: Configure SSO for Azure AD in the Configuration Guide |
...
| D s node |
|---|
| D s node |
|---|
| Item | Minimum | Recommended | Notes, Limitations and Additional Doc |
|---|---|---|---|
| Number of Cores | 8 cores, x86_64 | 16 cores, x86_64 | |
| RAM | 64 GB | 128 GB | |
| Install disk space | 4 GB | 16 GB | |
| Total free disk space | 16 GB
| 100 GB
|
Details: System Requirements
| D s node |
|---|
| Item | Supported Versions | Notes, Limitations and Additional Doc | ||||
|---|---|---|---|---|---|---|
| Operating System |
|
| ||||
| Java | Java 1.11 (runtime only) Java 1.8 (recommended) | |||||
| NginX | 1.20. |
| 1 | ||
| NodeJS | 14.17.5 |
Other requirements:
- Edge node: Platform must be installed on an edge node of the cluster.
- Root access: Required for installation
- SSL access: Access to the platform can be limited to SSL only. See Install SSL Certificate in the Install Guide.
- Internet access: If the
is not connected to the Internet, you must acquire additional software packages for the installation process. See Install Dependencies without Internet Access in the Install Guide.D s node
...
The
| D s platform |
|---|
| Item | Supported Versions | Notes, Limitations and Additional Doc | |||||
|---|---|---|---|---|---|---|---|
| PostgreSQL | 12.X 11.X (Azure installs only) |
| |||||
| MySQL | 5.7 Community
| Details: System Requirements |
See Install Databases in the Databases Guide.
Desktop Browsers
Desktop hardware
| Item | Supported Versions | Notes, Limitations and Additional Doc |
|---|---|---|
| Screen | 1280 x 720 pixels is recommended |
Desktop browsers
| Info | ||
|---|---|---|
NOTE: Stable browser versions released after a given release of
|
| Item | Supported Versions | Notes, Limitations and Additional Doc | ||
|---|---|---|---|---|
| Google Chrome | v.91 - v.93, and any stable version that is released prior to the next release of
| |||
| Mozilla Firefox | v.90 - v.92, and any stable version that is released prior to the next release of
| |||
| Microsoft Edge | v.91 - v.93, and any stable version that is released prior to the next release of
|
|
For more information, see Browser Requirements.
...
