Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version r092

...

  • Simple Storage Service (S3) is an online data storage service provided by Amazon, which provides low-latency access through web services. For more information, see https://aws.amazon.com/s3/.

 


Info

NOTE: Please review the limitations before enabling. See Limitations of S3 Integration below.

...

Info

NOTE: Avoid switching between user mode and system mode, which can disable user access to data. At install mode, you should choose your preferred mode.

...


System mode

(default) Access to S3 buckets is enabled and defined for all users of the platform. All users use the same AWS access key, secret, and default bucket.

...

Info

NOTE: Lower case values are required.

...


  • sse-s3
  • sse-kms
  • none

Server-side KMS key identifier

...

Creating additional S3 connections is not required. After you define S3 as your base storage layer, you can create user-specific access to S3 buckets through  

D s webapp
. For more information, see External S3 Connections.

Hadoop distribution-specific configuration

Hortonworks

...

.

...

Additional Configuration for S3

...

  • Restart 
    D s item
    services
    services
    , which may free up some temporary space.
  • Use the steps in the preceding solution to reassign a temporary directory for Spark to use (fs.s3a.buffer.dir). 

D s also
labels3