- Ingest of over 500 files through SFTP at one time is not supported.
- You cannot run jobs using Avro or Parquet sources uploaded via SFTP.
- When you specify a parameterized output as part of your job execution, the specified output location may include additional unnecessary information about the SFTP connection identifier. None of this information is sensitive. This is a known issue.
- Jobs can be executed from SFTP sources on the following running environments:
D s photon
- HDFS-based Spark, which includes Cloudera and Hortonworks