If you have integrated with an EMR cluster version 5.8.0 or later, you can configure your Hive instance to use AWS Glue Data Catalog for storage and access to Hive metadata.
Tip: For metastores that are used across a set of services, accounts, and applications, AWS Glue is the recommended method of access. |
For more information on AWS Glue, see https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hive-metastore-glue.html.
This section describes how to enable integration with your AWS Glue deployment.
AWS Glue tables can be read under the following conditions:
The Hive deployment must be integrated with AWS Glue.
NOTE: Hive connections are supported when S3 is the backend datastore. |
You cannot select datasets through the Database browser in the .
NOTE: Use of this integration requires the development of custom SQL queries against the AWS Glue metadata store. |
Please verify the following have been enabled and configured.
Your deployment has been configured to meet the Supported Deployment guidelines above.
You must integrate the platform with Hive.
NOTE: For the Hive hostname and port number, use the Master public DNS values. For more information, see https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-hive-metastore-glue.html. |
For more information, see Configure for Hive.
After the integration has been made between the platform and AWS Glue, you can import datasets using custom SQL queries. For more information, see Create Dataset with SQL.