Using an S3 Bucket

S3 Connectors are secure gateways through which data can be moved in and out of the Platform using S3 bucket transfers. It is referred to as a data storage connector. The first step in creating this connector is setting up a storage bucket to store the data you intend to access.

Note: You must have access to an AWS cloud account and know the AWS Account Number. See Creating a bucket for more information.

Create an S3 bucket

1. Log into your AWS account.

2. In the search bar type S3 or Bucket.
   Click enter.

3. Click on Create Bucket.

4. Under General Configuration:

   • Insert Bucket Name.

   • Select your AWS Region (any cross region transfers are handled appropriately if the bucket is in a different region from the platform)

   • (Optional) Copy settings from an existing bucket.

5. Under Object Owner:

   • Select ACLs Disabled (recommended).

6. Under Block Public Access settings for this bucket:

   • Select Block all Public Access.

7. Under Bucket Versioning:

   • Select Disable or Enable.
     Help: Versioning is a means of keeping multiple variants of an object in the same bucket. You can use versioning to preserve, retrieve, and restore every version of every object stored in your Amazon S3 bucket. With versioning, you can easily recover from both unintended user actions and application failures.

8. (Optional) Enable Tags.

9. Under Default encryption:

   • Select advanced settings if you want to Disable or Enable object lock.

10. Click Create bucket.

Now you are ready to connect your storage to the platform via a Connector.

Create the Connector

1. Click Manage on the Navigation bar.

2. Select Connectors to view the Manage Connectors screen

3. Click the Create Connector button at the top right

4. Enter a Name for your Connector and a Description (optional)

5. Choose Type > AWS S3.

6. Insert your S3 path.
   Example: s3://my-bucket/my-data
   This is the bucket name you set when you created your.

7. Select your AWS Region from the list.

8. Insert your IAM credentials (if requested)

   1. Insert your Amazon access key

   2. Insert your Amazon secret key

9. Add any Integration Metadata needed for programmatic integration.

10. Click Create. Connection test will run and if successful, will show Connection Test Status as Successful.

11. Follow the Your AWS S3 bucket policy steps

    • Navigate to the bucket in the AWS console S3 browser

    • Enter the `Permissions` tab and `Bucket Policy` option

    • Copy and paste the generated policy statement below into the text editor

    • Save

12. Click Close.