Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Comment: Published by Scroll Versions from space DEV and version next

...

For smaller datasets, the platform recommends using the 

d-s-serverphoton
 running environment.

For larger datasets, if the size information is unavailable, the platform recommends by default that you run the job on the Hadoop cluster. For these jobs, the default publishing action for the job is specified to run on the Hadoop cluster, generating the output format defined by this parameter. Publishing actions, including output format, can always be changed as part of the job specification. 

...

Acquire Hadoop cluster configuration files

Info

NOTE: If the

d-s-item
item
node
has been properly configured as a Hadoop Edge node, these files should already exist on the local node. The location of these files on the Hadoop cluster may vary based on Hadoop distribution, version, and enabled components. For more information, please contact your Hadoop administrator.

...

Info

NOTE: If these configuration files change in the Hadoop cluster, the versions installed on the

d-s-item
item
node
should be updated, or components may fail to work. You may be better served by setting permissions on these files so that they can be read by the
D s defaultuser
Typehadoop
Fulltrue
user and then creating a symlink from the
D s platform
node.

...

If you are using Hortonworks, you must complete the following modification to the site configuration file that is hosted on the 

d-s-item
item
node

Info

NOTE: Before you begin, you must acquire the full version and build number of your Hortonworks distribution. On any of the Hadoop nodes, navigate to /usr/hdp. The version and build number is a directory in this location, named in the following form: A.B.C.D-XXXX.

...