GCP BigLake Iceberg

The GCP BigLake Iceberg connector integrates with Apache Iceberg tables managed by the BigLake Metastore on Google Cloud. It manages tables directly through the BigLake API and loads or queries data through the BigQuery Jobs API, automatically handling long-running jobs with built-in polling.

Install GCP BigLake Iceberg from the community library

Complete the following steps to install the GCP BigLake Iceberg connector from the community library:

1

Open the recipe editor and search for a connector. Alternatively, you can search for a connector in the community library.

Search for recipe editorSearch for community connectors in the recipe editor

2

Select the community connector you plan to install.

3

Click Install to install the connector from the community library.

Click installClick Install

4

Select Release connector. Alternatively, select Review code to review and modify the connector code before releasing it to the workspace.

Release connectorRelease the connector

5

Summarize any changes you made to the connector, then click Release to allow workspace collaborators to use the connector in recipes.

The Confirm release dialogThe Confirm release dialog

Connection setup

The GCP BigLake Iceberg connector uses custom authentication with a Google Cloud service account and a JWT bearer token.

Minimum and default scopes

Grant your Google Cloud service account the following minimum permissions:

  • biglake.tables.create
  • biglake.tables.get
  • biglake.tables.list
  • bigquery.jobs.create
  • storage read/write access on your warehouse bucket.

Refer to the Google Cloud Service accounts documentation for more information about service accounts.

GCP BigLake Iceberg set up

Complete the following steps to create a Google Cloud service account to establish a connection to GCP BigLake Iceberg in Workato:

1

Create a service account in your Google Cloud project and download its JSON key file. Refer to the Google Cloud Create and delete service account keys documentation for detailed steps.

2

Grant the service account the permissions listed in Minimum and default scopes.

3

Enable the BigLake API (biglake.googleapis.com) and the BigQuery API (bigquery.googleapis.com) in your project. Refer to the Google Cloud Enable and disable APIs documentation for complete steps.

Connect to GCP BigLake Iceberg using custom authentication

Complete the following steps to connect to GCP BigLake Iceberg in Workato:

1

Click Create > Connection.

2

Search for and select GCP BigLake Iceberg as your connection.

3

Enter a name for your connection in the Connection name field.

4

Use the Location drop-down menu to select the project where you plan to store the connection.

5

Provide the email of the service account you created in the Service account email field, for example [email protected].

6

Copy and paste the private key from the downloaded service account JSON key file, including the BEGIN/END lines, into the Private key field.

7

Provide the default Google Cloud project ID billed for requests in the Project ID field, for example my-gcp-project.

8

Optionally, provide the default region for BigLake catalogs and BigQuery jobs in the Default location field, for example us-central1 or US. You can override this value per action.

9

Click Connect.

Last updated: