Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Depending on your S3 environment, you can define:

  • S3 as base storage layer
  • S3 access protocol method
  • read access to S3
  • S3 bucket that is the default write destination
  • access to additional S3 buckets

...

For more information on setting the base storage layer, see Set Base Storage Layer.

...

The 

D s platform
 requires use of S3a protocol to connect to S3. 

Info

NOTE: Use of s3n is not supported.

Enable read access to S3

When read access is enabled,

D s item
itemusers
 can explore S3 buckets for creating datasets. See S3 Browser.

...

  1. Define S3 to be the base storage layer. See Set Base Storage Layer.
  2. Enable read access. See Enable read access.
  3. Specify a value for  aws.s3.bucket.name, which defines the S3 bucket where data is written. Do not include a protocol identifier. For example, if your bucket address is s3://MyOutputBucket, the value to specify is the following:

    Code Block
    MyOutputBucket


    Info

    NOTE: Specify the top-level bucket name only. There should not be any backslashes in your entry.


Info

NOTE: This bucket also appears as a read-access bucket if the specified S3 user has access.

...

  1. Specify the extraBuckets  array as a comma-separated list of buckets as in the following: 

    Code Block
    "extraBuckets": ["MyExtraBucket01","MyExtraBucket02","MyExtraBucket03"]


    Info

    NOTE: Specify the top-level bucket name only. There should not be any backslashes in your entry.


  2. These values are mapped to the following bucket addresses:

    Code Block
    s3://MyExtraBucket01
    s3://MyExtraBucket02
    s3://MyExtraBucket03


...