D toc |
---|
Overview
The
D s platform | ||
---|---|---|
|
...
multiple methods of authenticating to AWS resources. At the topmost level, authentication can be broken down into two modes: system and user.
- System mode: One set of credentials is used for each user of the platform to authenticate to AWS.
User mode: Individual user accounts must be configured with AWS credentials.
Info NOTE: This section covers how to manage AWS credentials through the APIs for individual users (user mode). When in system mode, please manage AWS configuration through the application.
...
Per-User Authentication Methods
To connect to AWS resources and access S3 data, the following information is required for each user, depending on the method of
...
authentication.
Method 1 - AWS Key and Secret
If users are providing key-secret combinations, the following information is required.
Item | Description |
---|---|
key/secret | (credential provider type is default ) The AWS key and secret for the user to authenticate |
default bucket | The default S3 bucket where the user can upload data and store generated results |
extra buckets | Any extra S3 buckets to which the user should have access |
Method 2 - AWS IAM Role
...
ARNs
Users can access AWS resources
...
At the API level, these roles can be associated with an AWSConfig object, which is then associated with users. Details are provided later.
...
by assigning an awsConfig object to the account.
Tip |
---|
Tip: This method is recommended. |
The following information is required:
Item | Description |
---|
...
IAM role | (credential provider type is |
...
IAM role to use to authenticate.
| ||
default bucket | The default S3 bucket where the user can upload data and store generated results | |
extra buckets | Any extra S3 buckets to which the user should have access |
...
Authentication objects
For each authentication method, the above pieces of information must be provided for each user.
...
D s platform |
---|
...
These pieces of information are defined in an awsConfig
object. An awsConfig object is a set of AWS configuration properties that can be created, modified, and assigned to individual users via API
...
Basic Workflow
- Acquire information.
- Locate the internal identifier for the user to which to assign the configuration object.
- Create an
awsConfig
object, assigning the object to the user as part of the process.- If you are using IAM roles, you can create one or more
awsRole
objects to map to correspondingawsConfig
objects.
- If you are using IAM roles, you can create one or more
Modify the object as needed.
- Verify that the assignment is working.
Step - Acquire information
Acquire all of the information listed above for the awsConfig object you wish to create. In this example, the credential provider type is set to temporary
, which means that authentication is determined by an IAM role.
Step - Locate user
Now, you need to locate the internal identifier for the user to which you wish to assign this AWS configuration.
Request:
...
None.
Response:
...
.
For Method 2, the awsConfig object maps to an awsRole object. An awsRole object references an IAM role and an awsConfig object. When you create an awsConfig object and its credential provider is set to temporary
, the awsRole object is automatically created for you:
- Each awsRole object maps to a single IAM role.
- Each awsRole object is mapped to an awsConfig object.
- The awsConfig object is then assigned to individual users.
- Through this mechanism, you have more flexibility in assigning the active role to users.
- As needed, the awsConfig object can be mapped at a later time to another awsRole object through the
role
attribute.
This workflow steps through the process for all these methods.
Basic Workflow
- Choose your method of authentication.
- Locate the internal identifier for the user to which to assign the configuration object.
- Create an
awsConfig
object, assigning the object to the user as part of the process. - Verify that the assignment is working.
Step - Acquire information
Acquire all of the information listed above for the awsConfig object you wish to create.
Step - Locate user
Now, you need to locate the internal identifier for the user to which you wish to assign this AWS configuration.
Request:
Endpoint | http://www.wrangle-dev.example.com:3005/v4/people |
---|---|
Authentication | Required |
Method | GET |
Request Body | None.
|
Response:
Status Code | 200 - Ok | ||
---|---|---|---|
Response Body |
|
...
For more information, see API AWSConfigs Put People Get v4.
Step - Create awsConfig object
...
Info |
---|
NOTE: Optionally, the |
...
assigned to the user who created it. |
Info |
---|
NOTE: For Method 2, an awsRole object is automatically created for you when you create the awsConfig object. It is mapped to the awsConfig object. |
Request:
Endpoint | http://www.wrangle-dev.example.com:3005/v4/awsConfigs | ||||
---|---|---|---|---|---|
Authentication | Required | ||||
Method | POST | ||||
Request Body | Method 1: AWS key-secret combination
Method 2: IAM role
|
Response for Method 2:
Status Code | 201 - Created | ||
---|---|---|---|
Response Body | Method 2 example:
|
|
|
|
|
Tip |
---|
Checkpoint: In the above, the awsConfig object has an internal identifier ( |
Step - (optional) Assign awsRole object to awsConfig object
If your credential provider is set to temporary
, you can create one or more awsRole objects. An awsRole object assigns an IAM role ARN to an awsConfig object.
...
|
Tip |
---|
Checkpoint: In the above, the awsConfig object has an internal identifier ( As part of the request, this object was assigned to user 2 The For more information, see API AWSConfigs Create v4. |
Step - Verify Authentication
To verify that the above configuration works:
- User id=2 should login to the application.
- User uploads assets through the Import Data page.
- User creates a short recipe that modifies these assets.
- User runs a job on that recipe to generate output to the default S3 bucket in CSV or JSON for downloading.
- User verifies that the results can be downloaded.
Tip |
---|
Checkpoint: Configuration and verification is complete. |
Step - For Method 2, assign new IAM role to awsConfig object
If you need to change the IAM role ARN for a user, you can modify the awsConfig object for that user with the new role information.
Info |
---|
NOTE: This section only applies of if |
Tip |
---|
Tip: In the preceding step, when you created the awsConfig object and inserts an IAM role ARN for the |
The following request creates the awsRole object and maps it to awsConfig id=6
.
...
set to
|
The following request modifies the awsConfig id=6
.
Request:
Endpoint | http://www.wrangle-dev.example.com:3005/v4/awsConfigs/6 | ||
---|---|---|---|
Authentication | Required | ||
Method | PUT | ||
Request Body |
|
Response:
Status Code | 200 - OK | ||
---|---|---|---|
Response Body |
|
Response:
Status Code | 201 - Created | ||
---|---|---|---|
Response Body |
|
Tip |
---|
Checkpoint: In the above step, you assigned an additional awsRole to the awsConfig object. For more information, see API AWSRoles Create v4. |
Step - Modify awsConfig object
Suppose you realize that there is missing extra bucket (extra-bucket3
) and that the role you specified is incorrect. You can use the following method to modify the created configuration object.
...
|
Tip |
---|
Checkpoint: In the above step, you assigned a new IAM role to the awsConfig object. The underlying awsRole object is created for you and automatically assigned. For more information, see API AWSRoles Create v4. |
Info |
---|
NOTE: After you have completed the above update, the previous awsRole object still exists. If the IAM role associated with it is no longer in use, you should delete the awsRole object. See API AWSRoles Delete v4. |
Step - Switching Authentication Methods
Suppose you have created your awsConfig objects to use the AWS Key-Secret method of authenticating. You have now created a set of IAM roles that you would like to assign to your
D s item | ||
---|---|---|
|
The generalized workflow for completing this task is the following:
- Acquire the identifiers for all of the awsConfigs you wish to modified. For each awsConfig, retain the
personId
, so that you can map your configuration changes to individuals. See API AWSConfigs Get v4.- For more information on getting your list of users, see API People Get v4.
For each user account (
personId
), you must identify the IAM role that you wish to assign it.- Use the following modification to the awsConfig object to switch to using the IAM role for the user:
Request:
Endpoint | http://www.wrangle-dev.example.com:3005/v4/awsConfigs/ |
---|
Authentication | Required | ||
---|---|---|---|
Method | PUT | ||
Request Body |
|
|
|
Response for Method 2:
...
Status Code | 200 - Ok | ||
---|---|---|---|
Response Body | Method 2 example:
|
|
|
|
|
|
Step - Verify Authentication
To verify that the above configuration works:
- User id=2 should login to the application.
- User uploads assets through the Import Data page.
- User creates a short recipe that modifies these assets.
- User runs a job on that recipe to generate output to the default S3 bucket in CSV or JSON for downloading.
- User verifies that the results can be downloaded.
|
Notes:
Item | Description |
---|---|
credentialProvider | To use IAM roles, this attribute must be updated to be temporary . |
role | The IAM role to assign to the configuration. |
personId | If needed, you can change the person (user) to which this awsConfig is applied. Note that the former user of the configuration cannot access AWS resources until you create a new configuration object for the user's account. |
activeRoleId | (response) Internal identifier of the awsRole object that was created for you and assigned to this awsConfig object. |
Info |
---|
NOTE: The above request must be applied to each awsConfig object that you wish to remap to using an IAM role. |