Set up a Databricks connector
Capabilities
Sync user identities from Databricks to ConductorOne
Resources supported:
- Accounts
- Groups
- Roles
- Service principals
- Workspaces
Provisioning supported:
- Accounts
- Groups
- Roles
- Service principals
- Workspaces
Add a new Databricks connector
This task requires either the Connector Administrator or Super Administrator role in ConductorOne.
In ConductorOne, click Connectors > Add connector.
Search for Databricks and click Add.
Choose how to set up the new Databricks connector:
Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)
Add the connector to a managed app (select from the list of existing managed apps)
Create a new managed app
Do you SSO into Databricks using your identity, SSO, or federation provider? If so, make sure to add the connector to the unmanaged Databricks app that was created automatically when you integrated your provider with ConductorOne, rather than creating a new managed app.
Set the owner for this connector. You can manage the connector yourself, or choose someone else. Setting multiple owners is allowed.
A Databricks connector owner must have the following permissions:
- Connector Administrator or Super Administrator role in ConductorOne
- Account admin role in role in each Databricks workspace you want to sync
- Click Next.
Next steps
If you are the connector owner, proceed to Configure your Databricks connector.
If someone else is the connector owner, ConductorOne will notify them by email that their help is needed to complete the setup process.
Configure your Databricks connector
A user with the Connector Administrator or Super Administrator role in ConductorOne and the Account admin role in each Databricks workspace you want to sync must perform this task.
Step 1: Look up your Databricks account ID
Ensure that your Databricks user account has the Account admin role and is assigned to each Databricks workspace you want to sync to ConductorOne.
In the Databricks account console, open the menu that appears next to your username in the upper right corner.
Carefully and copy and save account ID. We’ll use it in Step 2.
Step 2: Generate Databricks credentials
You have three authentication choices when setting up the Databricks connector:
OAuth (syncs info from all Databricks workspaces)
Follow the Databricks OAuth authentication documentation to create a service principal and create an OAuth secret.
Carefully copy and save the OAuth client ID and secret, then move on to Step 3.
Personal access token (syncs info from a single Databricks workspace)
In Databricks, navigate to Settings > Developer > Access tokens and click Manage.
Click Generate new token and create a new token.
Carefully copy and save the token, then move on to Step 3.
Username and password (syncs info from all Databricks workspaces)
You do not need to generate any additional credentials to use this method, and can move on to Step 3.
Step 3: Add your Databricks credentials to ConductorOne
In ConductorOne, navigate to the Databricks connector by either:
Clicking the Set up connector link in the email you received about configuring the connector.
Navigate to Connectors > Databricks (if there is more than one Databricks listed, click the one with your name listed as owner and the status Not connected).
Find the Settings area of the page and click Edit.
Select whether you’re authenticating with OAuth, a Personal access token, or your Username and password.
Paste the account ID you looked up in Step 1 into the Account ID field.
Enter the required OAuth, token, or username and password credentials into the other two fields.
Click Save.
The connector’s label changes to Syncing, followed by Connected. View the logs to ensure that information is syncing.
That’s it! Your Databricks connector is now pulling access data into ConductorOne.
Configure the Databricks integration using Terraform
As an alternative to the integration process described above, you can use Terraform to configure the integration between Databricks and ConductorOne.
See the ConductorOne Databricks integration resource page in the ConductorOne Terraform registry for example usage and the full list of required and optional parameters.