Using GCS

Google Cloud Storage (GCS) Connectors are secure gateways through which products can be moved in and out of the platform using GCS bucket transfers. It is referred to as a data storage connector. The first step in creating this connector is setting up a storage bucket to store the data you intend to access.

You must have access to a GCS cloud account. See Create storage buckets for more information. To create a GCP account, please visit Google Cloud Console. If you already have a GCP account, please follow the steps below.

Create a GCS bucket

1. Log into your GCS account.

2. Click Create a storage bucket.

3. Insert a Bucket Name following GCP's naming guidelines.

4. Choose where to store your data.

   • For learning purposes, choose Multi-region; however pick whichever works best for you.

5. Choose a storage class for your data.

   • For this example, select Standard.

6. Choose how to control access to objects.

   • For this example, select Fine-grained, which will enforce public access prevention.

7. Choose how to protect object data.

   • For this example, select None.

8. Press Create.

Now you are ready to connect your storage to the platform via a Connector.

Create a Service Account and Key File

The platform authenticates to your GCS bucket using a GCP service account JSON key file. You will need to create a service account and generate a key file before creating the connector.

Note: A paid GCP account is required to create service accounts and generate key files. Trial GCP accounts do not support this functionality.

1. In the Google Cloud Console, navigate to IAM & Admin > Service Accounts.

2. Click Create Service Account and follow the prompts to name and describe it.

3. Assign the following minimum roles to the service account:

   • storage.objectViewer (for read access)

   • storage.objectAdmin (for write access)

4. Once created, open the service account and navigate to the Keys tab.

5. Click Add Key > Create new key, select JSON, and click Create. The key file will download to your machine.

6. Ensure the service account has access to your GCS bucket by navigating to your bucket in Cloud Storage, clicking Permissions, and granting the service account the appropriate roles.

Create the Connector

1. Click Manage on the Navigation bar.

2. Select Connectors to view the Manage Connectors screen.

3. Click the Create Connector button at the top right.

4. Enter a Name for your Connector and a Description (optional).

5. Choose Type > GCS.

6. Enter the GCS bucket name.

7. (Optional) Enter the GCS subdirectory.

8. Upload your GCP Key File (the service account JSON file generated above).

9. Click Create. A connection test will run and, if successful, will show Connection Test Status as Successful.

10. Click Close.