Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r097

D toc

Excerpt

In

D s product
rtrue
, you can quickly connect to the provided datastores and import your file- or table-based datasets for use in the
D s webapp
. As needed, you can create connections to other datastores to which you have access and import from there.

Basic Import Process

There are multiple ways to import data into 

D s product
, but the most direct way is to import through the Library, where all imported datasets are stored. In the 
D s webapp
, click the Library icon in the left nav bar.

D caption
Library Page

Import Data

The Library displays all of the datasets to which you have access. To begin, click Import Data.

D caption
Import Data Page

When you import data, you are selecting a connection to use, which allows you to begin navigating the connected datastore. When you locate the file or table assets, you select it for import.

Info

NOTE: When you import a dataset, you are creating a reference to that source dataset. Data is not actually imported until

D s product
needs to use the data for job execution. Source data is never modified.

Tip

Need data? You may have example flows available in your workspace. Also, check out the available example datasets. See Example Datasets.

Default Connections

D s product
 provides pre-configured connections to storage. Depending on your environment, you may be able to immediately access data through the following datastores, which are represented by icons in the Import Data page:

iconConnectionDescription

Upload

Upload a file from your local desktop.

Tip

Tip: You can always upload a file from your local desktop for immediate use in the application. Details are below.

File-based storage

D s product
provides a connection to a primary file-based storage system. Also known as the base storage layer, this storage can be used for hosting datasets for import.

Uploaded files are stored on the base storage layer, as well as dataset samples. For more information, see Import a File from Storage.

Table-based storage

Your environment may be provided access to a table-based datastore, such as BigQuery or Redshift. From these datastores, you can select the tables or views to which you have access for import as datasets in 

D s product
. For more information, see Import a Table from Storage.

Other storageYou can create connections to other file- or table-based storage systems. See below for details.

Create Connections

You can create a connection to a wide variety of file-based and table-based datastores.

Info

NOTE: Before you create the connection, you must acquire access credentials to the datastore.

In the Import Data page, click the New icon at the bottom of the page. For more information, see Create a Connection.