Overview

The Amazon S3 connector provides a convenient way of exporting data directly from the Decentriq platform to an Amazon S3 bucket.

Prerequisites

• Have an Amazon S3 account.

• Have an existing Amazon S3 bucket where data can be uploaded.

• Have created IAM credentials with write permissions for the above bucket. The access key and secret key are required when exporting.

  • The following steps detail how to set up an IAM user and store the necessay credentials:

    1. Log in to your AWS account and navigate to IAM > Users

       

    2. Click Create user and provide an appropriate user name.

    3. Click Next and then set the necessary permissions. You can define the policy by selecting Attach policies directly and then clicking Create policy. The policy can be defined in JSON format by selecting the JSON button. Write access is necessary to allow Decentriq to upload data to the bucket. See here for more details on creating the read/write policies.

       

    4. Click Next to review and create the policy.

       

    5. Click Create user to create the user with the given permissions

       

    6. Next click on the newly created user and navigate to the Security credentials tab

       

    7. Click Create access key and select Third-party service

       

    8. Click Next and provide a description for your access key.

       

    9. Click Create access key and then click Download .csv file. Make sure you store this securely as the access key and secret key will be required when exporting data.

       

Step-by-step guide

1. Follow the steps to select a dataset for export and choose Amazon S3 from the list of connectors.

2. Input the requisite information (to find this information please refer to the Amazon documentation):

   • Bucket name: Name of the Amazon S3 bucket where the data should be exported.
     • This is the root name of the bucket. Subdirectories should be included as part of the object name.
   • Region code: Geographical region of the bucket.
   • Object name: Dataset name when uploaded to the bucket.
     • If the object to be stored is in a subdirectory, enter the full path omitting the bucket name.

       e.g. subdirectory/object_name.txt

   • Credentials: The access key and secret key associated with the Amazon S3 account.
   

3. After clicking the Export button navigate to the Imports/Exports tab on the Datasets page to track the status of the export.

   

4. Once completed, the dataset will be accessible in the specified Amazon S3 bucket.