Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Info

NOTE: For each user, a separate cluster is created. It may take a few minutes to spin up a new cluster.You cannot integrate with existing Azure Databricks clusters.

Pre-requisites

  • The 
    D s platform
     must be deployed in Microsoft Azure.  

...

For more information, see https://docs.databricks.com/user-guide/jobs.html.

Create Cluster

Info

NOTE: Integration with pre-existing Azure Databricks clusters is not supported.

When a user first requests access to Azure Databricks, a new Azure Databricks cluster is created for the user. Access can include a request to run a job or to browse Databricks Tables. Cluster creation may take a few minutes.

A new cluster is also created when a user launches a job after:

  • The Azure Databricks configuration properties or Spark properties are changed in platform configuration.
  • A JAR file is updated on the 
    D s node

A user's cluster automatically terminates after a configurable time period. A new cluster is automatically created when the user next requests access to Azure Databricks access. See "Configure Platform" below.

Enable

To enable Azure Databricks, please perform the following configuration changes. 

...