...
A sample is a selection of rows from your dataset, which can be used as the basis for building the transformation steps in your recipe. The
automatically creates initial data samples of your data whenever you create a new recipe for a dataset and enables you to create additional samples at any time using a variety of sampling techniques.D s webapp
Initial
...
Data
When you create a new recipe and load it in the Transformer page, the
| D s webapp |
|---|
...
data consists of the first X rows of the datasets, where X is determined by the following factors:
- The number of columns in the dataset
- The amount of data in each cell
- The maximum permitted size of each sample
...
- In the Transformer page, click the Eyedropper icon at the top of the page.
The Samples panel is displayed.
D caption Samples panel
At the top of the panel, you can review the Current Samplecurrent sample.
Tip Tip: If the current sample indicates Full Data, then In some cases, the entire dataset is displayed in the data grid. Unless you wish to use a specific sampling technique to filter down your data, sampling may not be useful across the entire dataset.
- Below the current sample, you can see the available sample types. To take a new random sample:
- Click the Random card.
Depending on your product edition, you may be able to select Quick Scan or Full Scan.
- Quick Scan creates your sample by making some assumptions about the data when it scans.
- Full Scan creates your sample by scanning across all rows of the dataset. This option can take awhile across a large dataset.
- Click Collect.
- The sampling job is queued for execution. When it completes, click Load Sample.
- The data grid is refreshed to display the rows gathered in the new random sample.
...
The above statement is best explained by example:
| Action | Sampling |
|---|---|
| 1. Create a new recipe and open it in Transformer page. | The initial sample is generated and displayed. |
| 2. Add 3 steps to your recipe. | The 3 new steps are applied to the initial sample in the browser's memory. |
| 3. Generate a new random sample. | The random sample is generated. When you load the sample, it is displayed in the data grid. |
| 4. Add 25 steps to your recipe. | The 25 new steps are applied to the random sample in the browser's memory. |
| 5. Select one of the first 3 steps of your recipe. | The initial sample is loaded and displayed. |
| 6. Insert a new step below the current one. | Now, the first 4 steps are displayed using the initial sample. |
Implications:
- As you add steps to your recipe without resampling, your recipe and sample consume more memory in your browser.
- When you perform complex multi-dataset operations, such as joins or unions, your recipe/sample combination consumes a lot more memory.
- If you continue adding steps:
- Performance in the browser can be impacted. Basic operations such as selection of data or new recipe steps can become slow to respond.
- The browser can crash.
...
