- Azure Databricks is an Apache Spark implementation that has been optimized for use on the Azure platform. For more information, see https://databricks.com/product/azure.
NOTE: For each user, a separate cluster is created. It may take a few minutes to spin up a new cluster.You cannot integrate with existing Azure Databricks clusters.
must be deployed in Microsoft Azure.
D s platform
For more information, see https://docs.databricks.com/user-guide/jobs.html.
NOTE: Integration with pre-existing Azure Databricks clusters is not supported.
When a user first requests access to Azure Databricks, a new Azure Databricks cluster is created for the user. Access can include a request to run a job or to browse Databricks Tables. Cluster creation may take a few minutes.
A new cluster is also created when a user launches a job after:
- The Azure Databricks configuration properties or Spark properties are changed in platform configuration.
- A JAR file is updated on the
D s node
A user's cluster automatically terminates after a configurable time period. A new cluster is automatically created when the user next requests access to Azure Databricks access. See "Configure Platform" below.
To enable Azure Databricks, please perform the following configuration changes.