Skip to main content
Skip table of contents

Create and Release an Asset

Creating an asset allows users to choose from a multitude of configured connector types. The data can stay at source or be ingested to the platform. This means that no data movement is necessary and the data does not need to be stored on any particular cloud provider.

Assets can be created from a range of connector types and sources:

External sources:

  • AWS S3

  • GCP GCS

  • Azure Blob storage

  • Snowflake

  • BigQuery

  • Upload from local drive

Internal sources:

  • Tasks

  • Spaces

Note: You must have an asset creator role to perform this action.

Create an Asset

  1. Navigate to the Assets feature by clicking Assets under the Manage menu.

  2. On the asset management page, click Create asset. This opens the first of two setup steps

Setup step 1

  1. Complete the form on setup step 1 providing

    1. Insert Asset name

    2. Select Source

    3. Select Connector

    4. Select Type of asset

      1. Table

      2. File

    5. Provide additional details about the source data. This will depend on the asset source:

      1. For cloud storage sources (e.g. S3, Azure Blob or GCS), this will be path to data

      2. For data warehouse sources (e.g. Snowflake or BigQuery) this will be a selection that is dependent on source, such as a database and table/view

    6. Indicate whether the path is to a single file or folder containing files and folders

    7. Select whether data is to be At source or On platform.

Important: Creating an At Source Asset means that the data will not be copied to the platform, it will remain at source and be accessed at source. There is no data movement occurring with this option.

Creating an On Platform Asset means that a copy is taken and stored on the Harbr platform.

Choosing At Source or On Platform is available optionality to support your specific data storage, location and movement requirements or restrictions.

Setup step 2

  1. Proceed to setup step 2 by clicking Start setup.

  2. View a summary of the values set on setup step 1

  3. Await completion of set up tasks, these could include

    1. Data access check (File and Table assets)

    2. Data format check (Table assets)

    3. Schema confirmation (CSV Table assets only)

      1. NB: In the case that the data format is found to be CSV, a schema review is required before setup can be completed. This is to allow any adjustments to the schema that has been discovered. This could be adjustments to table properties or data types. Often, no adjustment is necessary. Once this has been reviewed and the correct structure is available, the schema must be saved.

  4. Click Finish setup.

Releasing a new asset

Once you have completed the setup of an asset you will be directed to the asset overview page. The asset will be in a draft state.

The asset must be released to acquire a Live state. Only Live assets can be added to products or consumed in spaces or export.

You can release an asset once any format validation or copy jobs have completed. These wont take more than a few minutes.

The release panel is found on the right of the asset overview page and the release button will be blue when its enabled and a release can be performed.

All tabs on the asset overview page are accessible and editable while the asset is being prepared for release so you can make adjustments to any asset details in the meantime.


References and FAQs

Asset Metadata Metrics

Transfer Notification File (TNF)

Related Pages

View and Manage an Asset

JavaScript errors detected

Please note, these errors can depend on your browser setup.

If this problem persists, please contact our support.