Using a GCS Bucket
Google Cloud Storage (GCS) Connectors are secure gateways through which products can be moved in and out of the platform using GCS bucket transfers. It is referred to as a data storage connector. The first step in creating this connector is setting up a storage bucket to store the data you intend to access.
Note: You must have access to an GCS cloud account and know the GCS Account Number. See Create storage buckets for more information. To create a GCP account, please visit Google Cloud Console. If you already have a GCP account, please follow the steps below.
Create a GCS bucket
Log into your GCS account.
Click Create a storage bucket.
Insert Bucket Name following GCP’s naming guidelines
Choose where to store your data
For learning purposes, choose Multi-region; however pick whichever works best for you
Choose a storage class for your data
For this example, select Standard
Choose how to control access to object
For this example, select Fine-grained which will enforce public access prevention
Choose how to protect object data
For this example, select None
Press Create
Now you are ready to connect your storage to the platform via a Connector.
Create the Connector
Click Manage on the Navigation bar.
Select Connectors to view the Manage Connectors screen
Click the Create Connector button at the top right
Enter a Name for your Connector and a Description (optional)
Choose Type > GCS.
Enter your bucket name and optional subdirectory (path/to/dir). The Platform uses these locations when publishing and exporting to the connector.
Enter the GCS bucket name.
(Optional) Enter the GCS subdirectory.
Select GCP Key File (if requested)
Click Create and the New GCS connector information page will appear.
Help: This page informs you that the connector is ready and that the member account and roles are created. It also provides guidance on how to apply the required roles and access permissions to the bucket member account. Ensure bucket access control is set to Fine-grained.Go back to Google Console and log in
Go to your bucket
Click on Roles > Add
Add New principals (This is the member email given to you on platform once you create your connector)
Add the following roles:
Storage Legacy Bucket Writer
Storage Legacy Object Owner
Add any Integration Metadata needed for programmatic integration.
Click Create. Connection test will run and if successful, will show Connection Test Status as Successful.
Click Close.
