| D toc |
|---|
| Excerpt |
|---|
Use these guidelines and features to begin the process of diagnosing jobs that have failed. |
Job Types
The following types of jobs can be executed in the
| d-s-productplatform | ||
|---|---|---|
|
- Conversion jobs: Some datasources, such as binary file or JSON formats, must be converted to a format that can be easily read by the
. During data ingestion, the datasource is converted to a natively supported file format and stored on backend storage.D s webapp type Portal - Transform job: This type of job executes the steps in your recipe against the dataset to generate results in the specified format. When you configure your job, any set of selected output formats causes a transform job to execute according to the job settings.
- Profile job: This type of job builds a visual profile of the generated results. When you configure your job, select Profile Results to generate a profile job.
- Publish job: This job publishes results generated by the platform to a different location or datastore.
- Ingest job: This job manages the import of data from a JDBC source into the default datastore for purposes of running a transform or sampling job.
| Info |
|---|
...
NOTE: For each collected sample, a sample job ID is generated. In the Samples panel, you can view the sample job IDs for your samples. These job IDs enable you to identify the sample jobs in the Sample Jobs page. |
Identify Job Failures
When a job fails to execute, a failure message appears in following locations:
...
in the
...
The following is an example from the Jobs pageJob History page:
| D caption | ||
|---|---|---|
| ||
Publish job failed |
In the above example, the Transform and Profile jobs completed, but the Publish job failed. In this case, the results exist and, if the source of the problem is diagnosed, they can be published separately.
Invalid file paths
When your job uses files as inputs or outputs, you may receive invalid file path errors. Depending on the backend datastore, these can be one of the following:
- Path to the file is invalid for the current user. Path may be been created by another user that had access to the location.
- Path contains invalid characters in it. For more information, see Supported File Formats.
- Resource was deleted.
Jobs that Hang
In some cases, a job may stay in a pending state indefinitely. Typically, these errors are related to a failure of the job tracking service. You can try to the following:
...
You can try to re-execute the job using different options.
Tips:
- Disable flow optimizations. If your job is using data from a relational source that supports pushdowns, you can try to disable flow optimizations and then re-run the job. For more information, see Flow Optimization Settings Dialog.
- Look to cut data volume. Some job failures occur due to high data volumes. For jobs that execute across a large dataset, you can re-examine your data to remove unneeded rows and columns of data. Use the Deduplicate transformation to transformation to remove duplicate rows. See Remove Data.
- Gather a new sample. In some In some cases, jobs can fail when run at scale because the sample displayed in the Transformer page did not include problematic data. If you have modified the number of rows or columns in your dataset, you can generate a new sample, which might illuminate the problematic data. However, gathering a new sample may fail as well, which can indicate a broader problem. See Samples Panel.
Change the running environment. If the job failed on
, try executing it on another running environment.D s photon Tip Tip: The
running environment is not suitable for jobs on large datasets. Use the default running environment to execute your job.D s photon
Download Error Report
When a job fails, you can download an error report, which can be useful for diagnosing issues:
| Tip | |
|---|---|
Tip: If you are filing a request with
|
- Login to the the
as an admin or the user who created the job.D s webapp type Portal - Click the Jobs link in the left navigation bar.
- In the Jobs Job History page, click the identifier for the job that failed.
- In the Overview tab, review the Failed Stages entry or entries.
- To acquire the error report, click Download error report. Review and forward the report as needed.
For each job in the failing job group, the error report contains:
| Item | Description | ||||
|---|---|---|---|---|---|
| jobGroupId | The internal job identifier within the workspace where the error occurred. This value matches the job ID that is displayed in the
| ||||
| workspaceId | The identifier of the workspace where the error occurred
| ||||
| jobId | The ID for the specific job in the job group. These jobs can include sampling, profiling, transformation, writing results, ingesting data, and more.
| ||||
personId | The internal identifier of the user within the workspace | ||||
| status | The status of the job, such as "Failed", "Completed", "Pending". | ||||
| errorMessageId | The ID of the error message that is shown in the UI. | ||||
| errorTimestamp | Timestamp of the job failure. Not included if no error occurs for the job. | ||||
| uiErrorMessage | Error message that is shown in the job UI. Not included if no error occurs for the job. |
...
Contact Support
If you are unable to diagnose your job failure, please contact
| D s support |
|---|
...
Report an Issue
If you believe that your job has failed due to an issue with the
| d-s-productplatform |
|---|
| D s support |
|---|
| Info | ||||
|---|---|---|---|---|
NOTE:
|
Learn More
| D s also | ||||
|---|---|---|---|---|
|
