ETL: Distinct Transformation

Use the Distinct transformation to remove duplicate records from your data, keeping only unique rows based on all field values in ETL pipelines.

For example,you might need to filter out users’ double-clicks in events.

To obtain unique records:

1. Add a Distinct component where required in your package.

2. Open the component and name it.