Nailing the Security Audit with RRCU

ConductorOne docs

Set up a Databricks connector

ConductorOne provides identity governance and just-in-time provisioning for Databricks. Integrate your Databricks instance with ConductorOne to run user access reviews (UARs) and enable just-in-time access requests.

Capabilities

  • Sync user identities from Databricks to ConductorOne

  • Resources supported:

    • Accounts
    • Groups
    • Roles
    • Service principals
    • Workspaces
  • Provisioning supported:

    • Accounts
    • Groups
    • Roles
    • Service principals
    • Workspaces

Add a new Databricks connector

This task requires either the Connector Administrator or Super Administrator role in ConductorOne.

  1. In ConductorOne, click Connectors > Add connector.

  2. Search for Databricks and click Add.

  3. Choose how to set up the new Databricks connector:

    • Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)

    • Add the connector to a managed app (select from the list of existing managed apps)

    • Create a new managed app

    Do you SSO into Databricks using your identity, SSO, or federation provider? If so, make sure to add the connector to the unmanaged Databricks app that was created automatically when you integrated your provider with ConductorOne, rather than creating a new managed app.

  1. Set the owner for this connector. You can manage the connector yourself, or choose someone else. Setting multiple owners is allowed.

    A Databricks connector owner must have the following permissions:

    • Connector Administrator or Super Administrator role in ConductorOne
    • Account admin role in role in each Databricks workspace you want to sync
  1. Click Next.

Next steps

  • If you are the connector owner, proceed to Configure your Databricks connector.

  • If someone else is the connector owner, ConductorOne will notify them by email that their help is needed to complete the setup process.

Configure your Databricks connector

A user with the Connector Administrator or Super Administrator role in ConductorOne and the Account admin role in each Databricks workspace you want to sync must perform this task.

Step 1: Look up your Databricks account ID

  1. Ensure that your Databricks user account has the Account admin role and is assigned to each Databricks workspace you want to sync to ConductorOne.

  2. In the Databricks account console, open the menu that appears next to your username in the upper right corner.

  3. Carefully and copy and save account ID. We’ll use it in Step 2.

Step 2: Generate Databricks credentials

You have three authentication choices when setting up the Databricks connector:

  • OAuth (syncs info from all Databricks workspaces)

    1. Follow the Databricks OAuth authentication documentation to create a service principal and create an OAuth secret.

    2. Carefully copy and save the OAuth client ID and secret, then move on to Step 3.

  • Personal access token (syncs info from a single Databricks workspace)

    1. In Databricks, navigate to Settings > Developer > Access tokens and click Manage.

    2. Click Generate new token and create a new token.

    3. Carefully copy and save the token, then move on to Step 3.

  • Username and password (syncs info from all Databricks workspaces)

    You do not need to generate any additional credentials to use this method, and can move on to Step 3.

Step 3: Add your Databricks credentials to ConductorOne

  1. In ConductorOne, navigate to the Databricks connector by either:

    • Clicking the Set up connector link in the email you received about configuring the connector.

    • Navigate to Connectors > Databricks (if there is more than one Databricks listed, click the one with your name listed as owner and the status Not connected).

  2. Find the Settings area of the page and click Edit.

  3. Select whether you’re authenticating with OAuth, a Personal access token, or your Username and password.

  4. Paste the account ID you looked up in Step 1 into the Account ID field.

  5. Enter the required OAuth, token, or username and password credentials into the other two fields.

  6. Click Save.

  7. The connector’s label changes to Syncing, followed by Connected. View the logs to ensure that information is syncing.

That’s it! Your Databricks connector is now pulling access data into ConductorOne.

Configure the Databricks integration using Terraform

As an alternative to the integration process described above, you can use Terraform to configure the integration between Databricks and ConductorOne.

See the ConductorOne Databricks integration resource page in the ConductorOne Terraform registry for example usage and the full list of required and optional parameters.