5.3 Additional At Source BigQuery and S3 asset sources

Summary

• Further expansion of connectivity of Harbr Data platform:

  • Create and use at source assets from BigQuery, without having to move the data

  • Create and use at source assets from S3, without having to move the data

  • Create and use on platform assets from Snowflake and BigQuery and export Products or Assets to Snowflake and BigQuery locations (applies to assets that store tables) (now also available on GCP platform)

• Other improvements

  • At sourceSnowflake assets now show sample data, dictionary and metrics

Create and use on platform assets from Snowflake and BigQuery and export Products or Assets to Snowflake and BigQuery locations (applies to assets that store tables) (now also available on GCP platform)

These features are identical to AWS version described in 5.2 release notes.

Create a ‘At Source’ BigQuery asset

In addition to on platform BigQuery assets, you can now create at source platform BigQuery assets without moving the data.*

When creating an asset, you need to provide a connector, select dataset and table/view that will be used to create an asset. Only table assets can be created from this source. 

These assets behave the same way as other at source assets - they can be queried in Spaces, added to product but cannot be exported. 

*Available on both AWS and GCP platforms. 

Create and use an ‘At Source’ S3 asset

In addition to on platform S3 assets, you can now create at source platform S3 assets without moving the data.*

When creating an asset, you need to provide a connector and path that will be used to create an asset. Both table and file assets can be created from this source. 

These assets behave the same way as other at source assets - they can be queried in Spaces, added to product but cannot be exported. 

Row count is not available for this type of asset. 

*Available on both AWS and GCP platforms. 

Fixed bugs

• At source Snowflake assets now show sample data, dictionary and metrics

Release Start Date: 25th January 2024

 It might take a few days before the release is available in your platform(s).