Page tree

 

Contents:


The Trifacta® platform requires access to two databases.

  • Main database: storage of users and metadata about your datasets, including completed jobs.
  • Jobs database: storage of job tracking information. Jobs are purged upon completion or job timeout. Failed jobs are purged periodically. 

The scheduling feature is enabled by default. If it's enabled, the following databases are also required:

  • Scheduling database: Storage of schedules, including datasets to execute
  • Time-based Trigger database: Storage of triggering information.
  • For more information, see Configure Scheduling.

This section describes how to install the database server, after which you can create and initialize the databases and their users.

Limitations

  • You must install a supported version of the database. For more information on supported versions of this database type, see System Requirements.
  • SSL connections are not supported.

Pre-requisites

  • The installing user must have write permissions to the directory from which the commands are executed.
  • The installing user must have sudo privileges.

Acquire MySQL Java driver

The MySQL Java driver is not packaged with the Trifacta installer. If you are installing the Trifacta databases into MySQL, please acquire the following driver file:

mysql-connector-java-6.0.6.jar

This file can be downloaded from the following locations:

This file needs to be installed in the following locations on the Trifacta node:

/opt/trifacta/services/batch-job-runner/build/install/batch-job-runner/lib/
/opt/trifacta/services/scheduling-service/server/build/install/scheduling-service/lib/
/opt/trifacta/services/time-based-trigger-service/server/build/install/time-based-trigger-service/lib/

Select Configuration File

By default, the Trifacta platform assumes that you are installing the databases in a PostgreSQL instance. This configuration file is stored here:

/opt/trifacta/conf/trifacta-conf.json

If you are installing the database in a MySQL instance, a separate base configuration has been provided. This configuration file is stored next to the above:

/opt/trifacta/conf/trifacta-conf.json.MYSQL_DB

To use MySQL, you should back up the default configuration file and then copy the MySQL version in its place:

If you have already applied configuration changes to trifacta-conf.json through the above file or the Admin Settings page, these changes are lost when the following steps are performed. You must manually migrate those changes over or apply the MySQL changes manually.

cp /opt/trifacta/conf/trifacta-conf.json /opt/trifacta/conf/trifacta-conf.json.POSTGRES_DB
cp /opt/trifacta/conf/trifacta-conf.json.MYSQL_DB /opt/trifacta/conf/trifacta-conf.json

Database Install

PostgreSQL

NOTE: The following distributions and commands are for PostgreSQL 9.6.

O/S DistributionURLPackage Name
CentOS 6https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-6-x86_64/pgdg-centos96-9.6-3.noarch.rpmpostgresql96-server
CentOS 7https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpmpostgresql96-server
RHEL 6https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-6-x86_64/pgdg-centos96-9.6-3.noarch.rpmpostgresql96-server
RHEL 7https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpmpostgresql96-server


For CentOS 6.x:

wget https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-6-x86_64/pgdg-centos96-9.6-3.noarch.rpm
sudo yum -y install pgdg-centos96-9.6-3.noarch.rpm
sudo yum -y install postgresql96-server

For CentOS 7.x:

wget https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-centos96-9.6-3.noarch.rpm
sudo yum -y install pgdg-centos96-9.6-3.noarch.rpm
sudo yum -y install postgresql96-server

For Red Hat Enterprise Linux 6.x:

wget https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-6-x86_64/pgdg-redhat96-9.6-3.noarch.rpm
sudo yum -y install pgdg-redhat96-9.6-3.noarch.rpm
sudo yum -y install postgresql96-server

For Red Hat Enterprise Linux 7.x:

wget https://download.postgresql.org/pub/repos/yum/9.6/redhat/rhel-7-x86_64/pgdg-redhat96-9.6-3.noarch.rpm
sudo yum -y install pgdg-redhat96-9.6-3.noarch.rpm
sudo yum -y install postgresql96-server

For Ubuntu 14.04:

Add the repository's archive key to your apt-key keyring:

wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | sudo apt-key add -

Create a file named /etc/apt/sources.list.d/pgdg.list, containing the following:

deb http://apt.postgresql.org/pub/repos/apt/ trusty-pgdg main
deb-src http://apt.postgresql.org/pub/repos/apt/ trusty-pgdg main

Run the following command:

sudo apt-get update
sudo apt-get install -y postgresql-9.6

For Ubuntu 16.04:

Add the repository's archive key to your apt-key keyring:

wget --quiet -O - https://www.postgresql.org/media/keys/ACCC4CF8.asc | sudo apt-key add -

Create a file named /etc/apt/sources.list.d/pgdg.list, containing the following:

deb http://apt.postgresql.org/pub/repos/apt/ xenial-pgdg main

Run the following command:

sudo apt-get update
sudo apt-get install -y postgresql-9.6

MySQL

NOTE: The following distributions and commands are for MySQL Community Server 5.7.

O/S DistributionURLPackage Name
CentOS 6https://dev.mysql.com/get/mysql80-community-release-el6-1.noarch.rpmmysql-community-server
CentOS 7https://dev.mysql.com/get/mysql80-community-release-el7-1.noarch.rpmmysql-community-server
RHEL 6https://dev.mysql.com/get/mysql80-community-release-el6-1.noarch.rpmmysql-community-server
RHEL 7https://dev.mysql.com/get/mysql80-community-release-el7-1.noarch.rpmmysql-community-server
Ubuntu 14.04https://dev.mysql.com/get/mysql-apt-config_0.8.10-1_all.deb 
Ubuntu 16.04https://dev.mysql.com/get/mysql-apt-config_0.8.10-1_all.deb 


For CentOS 6.x: 

# Install MySql Repo List
sudo wget https://dev.mysql.com/get/mysql80-community-release-el6-1.noarch.rpm
sudo rpm -Uvh mysql80-community-release-el6-1.noarch.rpm
# Check list of available Mysql Repos; by default 8.0 is enabled, but we want 5.7
yum repolist all | grep mysql
# Disable 8.0 and enable 5.7
sudo yum-config-manager --disable mysql80-community
sudo yum-config-manager --enable mysql57-community
# Verify repo state
yum repolist all | grep mysql
# Install Mysql Server
sudo yum install mysql-community-server
# Start mysql server
sudo service mysqld start
# Verify status
sudo service mysqld status

For CentOS 7.x:

# Install MySql Repo List
sudo wget https://dev.mysql.com/get/mysql80-community-release-el7-1.noarch.rpm
sudo rpm -Uvh mysql80-community-release-el7-1.noarch.rpm
# Check list of available Mysql Repos; by default 8.0 is enabled, but we want 5.7
yum repolist all | grep mysql
# Disable 8.0 and enable 5.7
sudo yum-config-manager --disable mysql80-community
sudo yum-config-manager --enable mysql57-community
# Verify repo state
yum repolist all | grep mysql
# Install Mysql Server
sudo yum install mysql-community-server
# Start mysql server
sudo systemctl start mysqld.service
# Verify status
sudo systemctl status mysqld.service

For Red Hat Enterprise Linux 6.x: See CentOS 6 above.

For Red Hat Enterprise Linux 7.x: See CentOS 7 above.

For Ubuntu 14.04: 

# Install and configure repo config package
wget https://dev.mysql.com/get/mysql-apt-config_0.8.10-1_all.deb
sudo debconf-set-selections <<< "mysql-apt-config mysql-apt-config/select-server select mysql-5.7"
sudo DEBIAN_FRONTEND=noninteractive dpkg -i mysql-apt-config_0.8.10-1_all.deb
sudo apt-get update
# Set Installer configs Admin password and install MySql Server package 
sudo debconf-set-selections <<< "mysql-community-server mysql-community-server/root-pass password <MYSQL_ADMIN_PASSWORD>"
sudo debconf-set-selections <<< "mysql-community-server mysql-community-server/re-root-pass password <MYSQL_ADMIN_PASSWORD>"
sudo DEBIAN_FRONTEND=noninteractive apt-get install mysql-community-server
sudo service mysql start


For Ubuntu 16.04: 

# Install and configure repo config package
sudo apt-get update && sudo apt-get install lsb-release
wget https://dev.mysql.com/get/mysql-apt-config_0.8.10-1_all.deb
sudo debconf-set-selections <<< "mysql-apt-config mysql-apt-config/select-server select mysql-5.7"
sudo DEBIAN_FRONTEND=noninteractive dpkg -i mysql-apt-config_0.8.10-1_all.deb
sudo apt-get update
# Set Installer configs Admin password and install MySql Server package 
sudo debconf-set-selections <<< "mysql-community-server mysql-community-server/root-pass password <MYSQL_ADMIN_PASSWORD>"
sudo debconf-set-selections <<< "mysql-community-server mysql-community-server/re-root-pass password <MYSQL_ADMIN_PASSWORD>"
sudo DEBIAN_FRONTEND=noninteractive apt-get install mysql-community-server
sudo service mysql start

Acquire Port Information

After you have completed the installation, you must acquire the port information for each database from the following locations on the Trifacta node. These port numbers need to be applied inside the Trifacta platform.

NOTE: By default, PostgreSQL and the platform use port 5432 for communication. If that port is not available at install/upgrade time, the next available port is used, which is typically 5433. This change may occur if a previous version of PostgreSQL is on the same server. When a non-default port number is used, the platform must be configured to use it. For more information, see Change Database Port.

PostgreSQL

CentOS/RHEL (PostgreSQL 9.6):

/var/lib/pgsql/9.6/data/postgresql.conf

Ubuntu (PostgreSQL 9.6) :

/etc/postgresql/9.6/main/postgresql.conf

MySQL

CentOS/RHEL (MySQL 5.7):

The default port is 3306. See System Ports.

Ubuntu (MySQL 5.7) Not supported.

Update MySQL Password Policy

NOTE: This section only applies to CentOS and RHEL platforms only where MySQL is the installed database.

By default, MySQL enforces a stricter password policy on database passwords. If you prefer to set your own passwords outside of this policy, you must lower the password policy. Please complete the following steps:

# Get temporary root password from mysql log
sudo grep 'temporary password' /var/log/mysqld.log
# Connect to server as root
mysql -uroot -p
# Update password
ALTER USER 'root'@'localhost' IDENTIFIED BY '<my_new_password>';
# Unless you plan to update all the User passwords to be meet MySql Security requirements, you should set the password policy to low
SET GLOBAL validate_password_policy=LOW;

This page has no comments.