Skip to main content

Overview

The Google Cloud Storage (GCS) connector provides a convenient way of importing data directly from a GCS bucket into the Decentriq platform.

Prerequisites

  • Have a Google Cloud account.
  • Have an existing Cloud Storage bucket where data can be download from.
  • Have existing service account credentials.

Importing into the platform

GCS imports are configured as re-runnable import connectors on the Connectors page. In the connection step of the wizard, provide the following (see here for retrieving bucket related information):

  • Bucket: Name of the GCS bucket where the data should be imported from.
  • Path prefix: Optional prefix that limits the import to a folder within the bucket.
  • Service Account JSON: The service account credentials associated with the Google Cloud account (see the Google documentation for more details). This takes the form of a JSON file generated when setting up the service account and contains the following information:
      - **type**: Identifies the type of credentials (this will be set to *service_account*).
      - **project_id**: The ID of your Google Cloud project.
      - **private_key_id**: The identifier for the private key.
      - **private_key**: The actual private key used for authentication - in PEM format.
      - **client_email**: The email address of the service account.
      - **client_id**: A unique identifier for the service account.
      - **auth_uri**: The URL to initiate OAuth2 authentication requests.
      - **token_uri**: The URL to retrieve OAuth2 tokens.
      - **auth_provider_x509_cert_url**: The URL to get Google's public certificates for verifying signatures.
      - **client_x509_cert_url**: The URL to the public certificate for the service account.
      - **universe_domain:** The domain of the API endpoint

Google Cloud Storage connection step

See Import connectors for the full wizard walkthrough, including file filtering and dataset naming. Each run of the connector creates a new dataset on the Datasets page.