Data Reduction with Post-process Deduplication¶
In this step the data to be pre-processed is first stored entirely. Then a separate process selects the non-duplicate elements by comparison and stores them in a new block.
- A list of data elements
- A list of data elements excluding duplications