In the data grid, you can review how the current recipe applies to the individual columns in your sample. 


Data Grid Panel

Select:

Scroll:

Tip: If the contents of a cell are too large for the display, you can click the Caret ( > ) icon to the right of the cell value in the data grid to display the entire contents of the cell.

Add or Edit:

 

Ordering:

 

Transformer Toolbar

At the top of the data grid, you can use the toolbar to quickly build common transformations, filter the display, and other operations. See Transformer Toolbar.

Status Bar

Below the data grid, you can review summary information about the data in your currently selected sample. 

 

Sample Status Bar

Click the Eye icon to open the Visible Columns panel, where you can toggle the display of individual columns. For more information, see Visible Columns Panel.

The status bar contains metrics about the current dataset sample for the currently selected recipe step.

Tip: Before you begin transforming your data, you might want to verify the columns and count of data types against the data before it was imported. If there are discrepancies, you might want to investigate the differences. Unless your sample includes the entire dataset, row counts should differ.


NOTE: In the Photon running environment, results can differ between executions of the same recipe due to Photon's parallel execution and data limiting within the Transformer page. In particular, joins with multiple matches per key can sometimes cause a difference in the number of reported rows when the job is re-executed.

Show only affected:

When transform steps are previewed, you can use these checkboxes to display only the previewed changes for affected rows, columns, or both. 

Tip: These options assist in narrowing the data grid display to only the steps affected by the current recipe step.

Find Column

In a wide dataset, click the Find icon in the Transformer toolbar to locate the column of interest.

Find column search bar

 


Column Information

Column header, data quality bar, and histogram

At the top of the column, you can review:

 NOTE: In the column header, counts reflect only the counts in the currently loaded sample. They do not reflect counts across the entire dataset, unless the entire dataset is the sample.


ItemDescription
Data type

Identifies the selected data type, which can be inferred by the application based on the contents of the column. Click the icon to change the data type.

Tip: Before you start performing transformations on your data based on mismatched values, you should check the data type for these columns to ensure that they are correct. For more information, see Supported Data Types.

See Supported Data Types.

Column nameTo change the column name, select Rename... from the column menu.
Column menuDepending on the column data type, you can select from a set of predefined recipe steps in the column menu under the caret on the right side of the menu. See Column Menus.
Data quality bar

The horizontal line shows valid, missing, and mismatched values in the column compared to the column's data type.

Tip: You can click these colored bars to generate suggestion cards for transforms to act on these types of values.

See Data Quality Bars.

Column histogram

For each column, you can see the range and frequency of values in the column.

Tip: You can select one or more values a histogram to generate suggestion cards.

See Column Histograms.

Selecting values

You can click and drag to select values in a column:

Row Information

On the left side of the screen, you can see a column of black dots. If you hover over one of these, you can see the current row number and, if the information is still available, the row number for the row from the original source data. These values apply only to the sample in the current dataset.

Tip: To review the original row number for a row, hover over the black dot in the data grid. These values can be referenced using the SOURCEROWNUMBER function in your recipe steps. Some transform steps, such as pivot and union, may make the original row information invalid or otherwise unavailable, which disables this option. See SOURCEROWNUMBER Function.

Filter Data Grid

From the Filters drop-down, you can define filters to apply to columns, rows, or both in the data grid. See Filter Panel.

Transform Preview

Before a transform in development has been added to the recipe, a preview of the results is generated in the data grid. See Transform Preview.

Target Matching Bar

When a target has been assigned to your recipe, you can review the expected names and data types that are expected for the target in the Target Matching bar above the column histograms.

Target Matching Bar

In the Target Matching bar, you can review how the target above matches the current recipe below. For each column, matching assesses:


Tip: Two solid green schema tags indicate a perfect match based on the above conditions.

Actions:

For more information on the schema tags, see Column Browser Panel.