Set up a Google BigQuery connector

Capabilities

Resource	Sync	Provision
Accounts
Service accounts
Roles
Datasets

Gather Google BigQuery credentials

Configuring the connector requires you to pass in credentials generated in Google BigQuery. Gather these credentials before you move on.

A user with the permission to make a service account in Google Cloud must perform this task.

Create a service account

In the Google Cloud console, navigate to the Create service account page.

Select your project.

Choose a name for the service account and enter it in the Service account name field.Google Cloud automatically sets the service account ID based on the name you choose.

Enter a description for the service account in the Service account description field.

Click Create and continue.

From the Select a role list, grant the service account either the Viewer or BigQuery Data Viewer role.

Click Continue.

Click Done to create the service account.

Create a service account key

Still in the Google Cloud console, click the email address of the service account you created in Step 1.

Click Keys.

Click Add key > Create new key.

Click Create. A JSON file containing the account key is created and downloaded. Keep the downloaded file safe, you’ll use it to set up the connector.

Click Close.

That’s it! Next, move on to the connector configuration instructions.

Configure the Google BigQuery connector

To complete this task, you’ll need:

The Connector Administrator or Super Administrator role in ConductorOne
Access to the set of Google BigQuery credentials generated by following the instructions above

Cloud-hosted
Self-hosted

Follow these instructions to use a built-in, no-code connector hosted by ConductorOne.

In ConductorOne, navigate to Admin > Connectors and click Add connector.

Search for Google BigQuery and click Add.

Choose how to set up the new Google BigQuery connector:

Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)
Add the connector to a managed app (select from the list of existing managed apps)
Create a new managed app

Set the owner for this connector. You can manage the connector yourself, or choose someone else from the list of ConductorOne users. Setting multiple owners is allowed.If you choose someone else, ConductorOne will notify the new connector owner by email that their help is needed to complete the setup process.

Click Next.

Find the Settings area of the page and click Edit.

Upload the JSON file you created in the Credentials (JSON) field.

Click Save.

The connector’s label changes to Syncing, followed by Connected. You can view the logs to ensure that information is syncing.

That’s it! Your Google BigQuery connector is now pulling access data into ConductorOne.

Follow these instructions to use the Google BigQuery connector, hosted and run in your own environment.When running in service mode on Kubernetes, a self-hosted connector maintains an ongoing connection with ConductorOne, automatically syncing and uploading data at regular intervals. This data is immediately available in the ConductorOne UI for access reviews and access requests.

Step 1: Set up a new Google BigQuery connector

In ConductorOne, navigate to Connectors > Add connector.

Search for Baton and click Add.

Choose how to set up the new Google BigQuery connector:

Add the connector to a currently unmanaged app (select from the list of apps that were discovered in your identity, SSO, or federation provider that aren’t yet managed with ConductorOne)
Add the connector to a managed app (select from the list of existing managed apps)
Create a new managed app

Click Next.

In the Settings area of the page, click Edit.

Click Rotate to generate a new Client ID and Secret.Carefully copy and save these credentials. We’ll use them in Step 2.

Step 2: Create Kubernetes configuration files

Create two Kubernetes manifest files for your Google BigQuery connector deployment:

Secrets configuration

# baton-google-bigquery-secrets.yaml
apiVersion: v1
kind: Secret
metadata:
  name: baton-google-bigquery-secrets
type: Opaque
stringData:
  # ConductorOne credentials
  BATON_CLIENT_ID: <ConductorOne client ID>
  BATON_CLIENT_SECRET: <ConductorOne client secret>
data:
  # Google BigQuery credentials
  BATON_CREDENTIALS_JSON: <base64 encoded credentials JSON>

Base64 Encoding: Use echo -n "your-value" | base64 to encode your secrets.See the connector’s README or run --help to see all available configuration flags and environment variables.

Deployment configuration

# baton-google-bigquery.yaml
apiVersion: apps/v1
kind: Deployment
metadata:
  name: baton-google-bigquery
  labels:
    app: baton-google-bigquery
spec:
  selector:
    matchLabels:
      app: baton-google-bigquery
  template:
    metadata:
      labels:
        app: baton-google-bigquery
        baton: true
        baton-app: google-bigquery
    spec:
      containers:
      - name: baton-google-bigquery
        image: ghcr.io/conductorone/baton-google-bigquery:latest
        imagePullPolicy: IfNotPresent
        env:
        - name: BATON_HOST_ID
          value: baton-google-bigquery
        envFrom:
        - secretRef:
            name: baton-google-bigquery-secrets

Step 3: Deploy the connector

Create a namespace in which to run ConductorOne connectors (if desired), then apply the secret config and deployment config files.

Check that the connector data uploaded correctly. In ConductorOne, click Applications. On the Managed apps tab, locate and click the name of the application you added the Google BigQuery connector to. Google BigQuery data should be found on the Entitlements and Accounts tabs.

That’s it! Your Google BigQuery connector is now pulling access data into ConductorOne.

Welcome

Build connectors

Configure connectors

Deploy connectors

Upload connector data

Connector library

Set up a Google BigQuery connector

Capabilities

Gather Google BigQuery credentials

Create a service account

Create a service account key

Configure the Google BigQuery connector

Step 1: Set up a new Google BigQuery connector

Step 2: Create Kubernetes configuration files

Secrets configuration

Deployment configuration

Step 3: Deploy the connector

Welcome

Build connectors

Configure connectors

Deploy connectors

Upload connector data

Connector library

​Capabilities

​Gather Google BigQuery credentials

​Create a service account

​Create a service account key

​Configure the Google BigQuery connector

​Step 1: Set up a new Google BigQuery connector

​Step 2: Create Kubernetes configuration files

​Secrets configuration

​Deployment configuration

​Step 3: Deploy the connector

Capabilities

Gather Google BigQuery credentials

Create a service account

Create a service account key

Configure the Google BigQuery connector

Step 1: Set up a new Google BigQuery connector

Step 2: Create Kubernetes configuration files

Secrets configuration

Deployment configuration

Step 3: Deploy the connector