Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Edit the local version of mapred-site.xml. This file is typically located in /etc/conf/hadoop
  2. Specify the codecs to use in the io.compression.codecs property. Supported values:

    CodeValue
    Gzip
    org.apache.hadoop.io.compress.GzipCodec
    Bzip2
    org.apache.hadoop.io.compress.BZip2Codec
    Snappy
    org.apache.hadoop.io.compress.SnappyCodec
  3. In the following example, all three codecs have been specified:

    Code Block
    <configuration>
      ...
      <property>
        <name>io.compression.codecs</name>
       <value>org.apache.hadoop.io.compress.GzipCodec,org.apache.hadoop.io.compress.BZip2Codec,org.apache.hadoop.io.compress.SnappyCodec</value>
      </property>
      ...
    </configuration>
  4.  Save the file and restart the platform. See Start and Stop the Platform.

...

  1. .

Configure platform

Apply the following changes from within the application to enable the 

D s platform
 to communicate with the compressed cluster.

Steps:

  1. Login to the application. 
  2. In the Admin Settings page, set the following settings:

    SettingDescription
    hadoopDefaultClusterCompression.enabledTo enable integration with a compressed cluster, set this value to true.
    hadoopDefaultClusterCompression.compression

    Set this value to the type of compression applied on the cluster:

    none - (default) no cluster compression

    gzip

    bzip2

    snappy

  3. Save your changes and restart the platform.