==============================================
Data Reduction with Post-process Deduplication
==============================================
:doc:`/SingleStepClassifiers/CausalStep/index`

In this step the data to be pre-processed is first stored entirely. Then a separate process selects the non-duplicate elements by comparison and stores them in a new block.

.. rubric:: Input Parameters

1. A list of data elements

.. rubric:: Output Parameters

1. A list of data elements excluding duplications

.. rubric:: Workflow

.. image:: workflow.svg


.. rubric:: References

- W.\  Curtis Preston, In-line or post-process de-duplication? (updated 6-08), Backup Central. Retrieved 2009-10-16.

  `http://www.backupcentral.com/mr-backup-blog-mainmenu-47/13-mr-backup-blog/134-inline-or-post-process.html <http://www.backupcentral.com/mr-backup-blog-mainmenu-47/13-mr-backup-blog/134-inline-or-post-process.html>`__