Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Create an imported dataset from an available resource. Created dataset is owned by the authenticated user.

Info

NOTE: When an imported dataset is created via API, it is always imported as an unstructured dataset. Any recipe that references this dataset should contain initial parsing steps required to structure the data.

Info

NOTE: Do not create an imported dataset from a file that is being used by another imported dataset. If you delete the newly created imported dataset, the file is removed, and the other dataset is corrupted. Use a new file or make a copy of the first file first.

...

Request Body - HDFS file:Below, the bucket value is set to null. This parameter applies only to S3 sources.

Info

NOTE: The path value should not include the HDFS protocol, host, or port information. You only need to provide the path on HDFS.


Info

NOTE: Below, the detectStructure parameter forces the

D s platform
to apply initial parsing steps on import.


Code Block
{
  "path": "/tri-hdfs/uploads/1/4aee9852-cf92-47a8-8c6a-9ff2adeb3b4a/POS-r02.txt",
  "type": "hdfs",
  "bucket": null,
  "name": "POS-r02b.txt",
  "description": "POS-r02 - copy",
  "detectStructure": true
}

 

Request Body - S3 file:

...