...
- Snowflake is an S3-based data warehouse service hosted in the cloud. Auto-scaling, automatic failover, and other features simplify the deployment and management of your enterprise's data warehouse. For more information, see https://www.snowflake.com.
Supported Environments:
| Operation |
| Amazon | Microsoft Azure | |
|---|---|---|---|---|
| Read | Not supported | Supported | Not supported | |
| Write | Not supported | Supported | Not supported |
Prerequisites
- S3 base storage layer: Snowflake access requires installation of
in the AWS infrastructure and use of S3 as the base storage layer, which must be enabled. See Set Base Storage Layer.D s item item software
...
- PUBLIC schema: If you do not create an external staging database:
- A
PUBLICschema is required in your default database. - If you do not provide a stage database, then a temporary stage is created for you under the
PUBLICschema in the default database.
- A
- S3 bucket: The user-created stage must point to the same S3 bucket as the default bucket in use by
.D s product
- Same region: The Snowflake cluster must be in the same region as the default S3 bucket.
- IAM role requirements: If you are accessing AWS and Snowflake using IAM roles, please verify that the appropriate permissions have been assigned to the role to access Snowflake and its backing S3 buckets. For more information, see Required AWS Account Permissions.
- Staging database: Snowflake supports the use of a stage for reading and writing data to S3 during job executions.
...
- Login to the application.
- In the left nav bar, click the Connections icon.
- In the Create Connection page, click the Snowflake connection card.
Specify the properties for your Snowflake database connection. The following parameters are specific to Snowflake connections:
Info NOTE: In Snowflake connections, property values are case-sensitive. Snowflake-related locations are typically specified in capital letters.
| Property | Description | ||||||
|---|---|---|---|---|---|---|---|
| Account Name | Snowflake account to use. Suppose your hostname is the following:
Your account name is the following:
| ||||||
| Warehouse | The name of the warehouse to use when connected. This value can be an empty string. If specified, the warehouse should be an existing warehouse for which the default role has privileges. | ||||||
| Stage | If you have deployed a Snowflake stage for managing file conversion to tables, you can enter its name here. A stage is a database object that points to an external location on S3. It must be an external stage containing access credentials. If a stage is used, then this value is typically the schema and the name of the stage. Example value:
If a stage is not specified, a temporary stage is created using the current user's AWS credentials.
For more information on stages, see https://docs.snowflake.net/manuals/sql-reference/sql/create-stage.html. | ||||||
| Credential Type | Select the type of credentials to provide with the connection:
| ||||||
| Database for Stage | (optional) If you are using a Snowflake stage, you can specify a database other than the default one to host the stage.
If no value is specified, then your stage must be in the default database. |
For more information, see Create Connection Window.
...
- Type:
snowflake - vendor:
snowflake
Troubleshooting
| Error Message | Description |
|---|---|
| Null values in some columns for all rows | When there are spaces/special characters in columns names, null values can be inserted for all rows in the column. The workaround is to remove any special characters and spaces from column names. |
Testing
Import a dataset from Snowflake. Add it to a flow, and specify a publishing action back to Snowflake. Run a job.For more information, see Verify Operations.
...
You can create a
| D s item | ||
|---|---|---|
|
...
Snowflake
...
.
Writing to Snowflake
You can write back data to Snowflake using one of the following methods:
...
