This section describes how you interact through the with your SQL DW
|D s conntype|
- is a scalable data warehouse solution available through Microsoft Azure. For more information, see https://docs.microsoft.com/en-us/azure/sql-data-warehouse/sql-data-warehouse-overview-what-is.
- Microsoft SQL DW connections are
- connections can interact with data stored as managed tables or external tables.
- connections can use dedicated or serverless SQL pools.
- For more information, see Microsoft SQL Data Warehouse Connections.
- connections are available only if you have deployed the onto Azure.
When using the SQL DW read-write connection, the The defined length of a table row cannot exceed 1 MB.
NOTE: In this release, this connection cannot be created through the APIs. Please create connections of this type through the application.
can use SQL DW for use for
the following tasks:
- Create datasets by reading from SQL DW tables.Write to SQL DW tables from tables.
Write to tables with your job results.
Ad-hoc publication of data to SQL DWto .
Before You Begin
Enable SQL DW Access: SQL DW integration Integration requires the following:
- Installation of the on Microsoft Azure.
- Either ADL or WASB is supported as the base storage layer. For more information, see Set Base Storage Layer.
Read Access: Your SQL DW administrator must configure read permissions. Your administrator should provide a database for upload to your SQL DW datastore.
Write Access: You can write and publish jobs results to SQL DWto .
SQL DW These connections require SSL access.
should provide database access for storing datasets. Users should know where shared data is located and where personal data can be saved without interfering with or confusing other users.
NOTE: The does not modify source data in SQL DW. Datasets sourced from SQL DW connections are read without modification from their source locations.
You can create a
from a table stored in SQL DWmanaged or external table through
For more information, see Database Browser.
You can write back data to SQL DW using to using
one of the following methods:
NOTE: Writing and publishing to SQL DW is not supported if Azure AD SSO has been enabled.
- Job results can be written directly to SQL DW as to as part of the normal job execution. Create a new publishing action to write to SQL DW. See Run Job Pageto . See Microsoft SQL Data Warehouse Table Settings.
As needed, you can publish results to SQL DW for previously executed jobs.
NOTE: You cannot re-publish results to SQL DW if the original job published to SQL DW. However, if the dataset was transformed but publication to SQL DW failed, you can publish from the Publishing dialog.
NOTE: To publish to SQL DW, the source results must be Parquet format.
See Publishing Dialogto for previously executed jobs.
For more information on how data is converted to SQL DW
to , see SQL DW Data Type Conversions.
Data Validation issues:
- No validation is performed for the connection and any required permissions during job execution. So, you can be permitted to launch your job even if you do not have sufficient connectivity or permissions to access the data. The corresponding publish job fails at runtime.
- No data validation is performed during writing and publication to SQL DWto . Your job fails if the schema for the varies from the target schema.
- Prior to publication, no validation is performed on whether a target is a table or a view, so the job that was launched fails at runtime.