Contents:
IAM roles
Before you begin, your IAM roles should be defined and attached to the associated EC2 instance.
NOTE: The IAM instance role used for S3 access should have access to resources at the bucket level.
For more information, see http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/iam-roles-for-amazon-ec2.html.
AWS System Mode
To enable role-based instance authentication, the following parameter must be enabled.
"aws.mode": "system",
Additional AWS Configuration
The following additional parameters must be specified:
| Parameter | Description |
|---|---|
aws.credentialProvider | Set this value to instance. IAM instance role is used for providing access. |
aws.hadoopFsUseSharedInstanceProvider | Set this value to Hortonworks and CDH 5.11 and earlier: "com.amazonaws.auth.InstanceProfileCredentialsProvider", CDH 5.11 and later: "org.apache.hadoop.fs.s3a.SharedInstanceProfileCredentialsProvider" In the future: CDH is moving back to using the |
Use of S3 Sources
To access S3 for storage, additional configuration for S3 may be required.
NOTE: Do not configure the properties that apply to user mode.
See Enable S3 Access.
This page has no comments.