Google Cloud BigQuery BigLake API Client Library

0.7.0 · active · verified Thu Apr 09

The `google-cloud-bigquery-biglake` library is the Python client for the Google Cloud BigLake API. BigLake serves as a unified storage engine, simplifying data access for data warehouses and data lakes. It offers uniform, fine-grained access control across multi-cloud storage solutions like Google Cloud Storage, Amazon S3, and Azure Data Lake Storage, and supports querying open-source table formats such as Apache Iceberg in BigQuery. This library is part of the larger `google-cloud-python` monorepo, suggesting a consistent release and maintenance cadence aligned with other Google Cloud client libraries.

Warnings

breaking The library is currently at version 0.7.0. While API stability is generally high for Google Cloud client libraries, pre-1.0.0 versions may introduce breaking changes in minor releases. Always review release notes when upgrading to new minor versions (e.g., 0.7.x to 0.8.x).
Fix: Consult the `google-cloud-python` monorepo release notes for `google-cloud-bigquery-biglake` prior to upgrading to new minor versions.
gotcha The BigLake API must be explicitly enabled in your Google Cloud project before you can use this client library to interact with BigLake resources.
Fix: Enable the BigLake API via the Google Cloud Console or `gcloud services enable biglake.googleapis.com`.
gotcha Proper authentication is required. For local development, Application Default Credentials (ADC) are recommended, often set up using `gcloud auth application-default login` or by setting the `GOOGLE_APPLICATION_CREDENTIALS` environment variable to a service account key file.
Fix: Ensure your environment is authenticated correctly. On Google Cloud infrastructure, credentials are often discovered automatically through the attached service account.
gotcha The library's logging is not configured by default and may contain sensitive information.
Fix: Configure logging explicitly if needed. You can set the `GOOGLE_SDK_PYTHON_LOGGING_SCOPE` environment variable or use advanced code-based configuration. Be mindful of sensitive data in logs.

Install

pip install google-cloud-bigquery-biglake Install stable version

Imports

BigLakeServiceClient

from google.cloud.bigquery_biglake_v1 import BigLakeServiceClient

Quickstart

This quickstart demonstrates how to initialize the BigLakeServiceClient and list available BigLake catalogs within a specified Google Cloud project and location. Ensure your `GOOGLE_CLOUD_PROJECT` and `GOOGLE_CLOUD_LOCATION` environment variables are set or replace the placeholder values. Authentication typically relies on Application Default Credentials.

import os
from google.cloud.bigquery_biglake_v1 import BigLakeServiceClient

# Set your Google Cloud Project ID and a location (e.g., 'us-central1')
project_id = os.environ.get('GOOGLE_CLOUD_PROJECT', 'your-gcp-project-id')
location = os.environ.get('GOOGLE_CLOUD_LOCATION', 'us-central1')

# Ensure you have authenticated to Google Cloud. For local development, use:
# gcloud auth application-default login

def list_biglake_catalogs(project_id: str, location: str):
    """Lists BigLake catalogs in a given project and location."""
    client = BigLakeServiceClient()
    parent = f"projects/{project_id}/locations/{location}"

    print(f"Listing BigLake catalogs in {parent}:")
    try:
        # The list_catalogs method returns an iterable of Catalog objects
        for catalog in client.list_catalogs(parent=parent):
            print(f"  Catalog: {catalog.name}")
    except Exception as e:
        print(f"An error occurred: {e}")
        print("Ensure the BigLake API is enabled for your project and the service account has 'biglake.catalogs.list' permission.")

if __name__ == "__main__":
    list_biglake_catalogs(project_id, location)

view raw JSON →