Data Reduction with Post-process DeduplicationΒΆ

Causal Step

In this step the data to be pre-processed is first stored entirely. Then a separate process selects the non-duplicate elements by comparison and stores them in a new block.

Input Parameters

  1. A list of data elements

Output Parameters

  1. A list of data elements excluding duplications

Workflow

../../../../_images/workflow54.svg