Import from external source
There are two different paths to import data from an external source, depending on the source:
- Cloud storage buckets (Amazon S3, Google Cloud Storage, Microsoft Azure) are imported through re-runnable import connectors.
- All other sources (Permutive, Salesforce, Snowflake) are imported through a one-time import from the Datasets page.
Cloud storage buckets: import connectors
For Amazon S3, Google Cloud Storage, and Microsoft Azure, you configure an import connector once and run it whenever you need. Each run creates a new date-stamped dataset. See the supported data sources for the provider-side prerequisites.
Other sources: one-time import
For Permutive, Salesforce, and Snowflake, navigate to the Dataset Portal, click the Upload dataset button, and select the import option (the dialog is titled "Import dataset"). Then choose the source and enter the connection details and credentials, see the supported data sources for detailed documentation. Imported datasets are stored as unstructured files (see Dataset types).
As the import may take a while, it runs in the background and you can continue to use the platform. The status of the import can be found in the Imports/Exports tab of the Dataset Portal. Once the import has completed, the dataset appears in the Datasets tab.
Not all supported external sources are enabled by default. If you need additional sources enabled, contact your customer success representative.
Decentriq does not have access to the credentials nor to the imported files, as the data connector tooling leverages confidential computing technology which prevents everyone except the data owner from having access to the data.
You can also import data programmatically with the Python SDK.