Data Reduction with Post-process Deduplication

Causal Step

In this step the data to be pre-processed is first stored entirely. Then a separate process selects the non-duplicate elements by comparison and stores them in a new block.

Input Parameters

1. A list of data elements

Output Parameters

1. A list of data elements excluding duplications

Workflow

References

• W. Curtis Preston, In-line or post-process de-duplication? (updated 6-08), Backup Central. Retrieved 2009-10-16.

  http://www.backupcentral.com/mr-backup-blog-mainmenu-47/13-mr-backup-blog/134-inline-or-post-process.html