Page tree

Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

The following transforms might make file path information invalid or otherwise unavailable:

  • pivot
  • join
  • unnest
  • deduplicate
Info

NOTE: This reference returns null values for values from relational database sources.

...

Info

NOTE: This reference returns the file path. It does not include the scheme or authority information from the URI. So, protocol identifiers such as http:// are not available in the output.

Info

NOTE: For Avro sources, if you imported a folder containing multiple Avro files, the folder path is returned. The full path is returned for single Avro files and for other multi-file datasets.

Supported File Formats

Base file formats:

...

File format
Supported?
Notes
AvroYesFor Avro sources, if you imported a folder containing multiple Avro files, the folder path is returned. The full path is returned for single Avro files and for other multi-file datasets.  
ParquetNo 

Other source types:

...

D code

derive type: single value: ($sourcerownumber - filled_start_file_offset) + 1 as: 'source_row_number_per_file'

Drop Delete the columns used for the intermediate calculations:

...