======================================================================================================= Welcome to Data Processing Compendium – Workflows for Knowledge Exploitation in the Process Industries! ======================================================================================================= The *Data Processing Compendium* is a catalogue of methods for data processing, so far with a focus on data pre-processing. The compendium is a key result of the AiF research project *Knowledge based pre-processing of process data (IGF-Vorhaben Nr. 16901 N)*. The project has been conducted by `AixCAPE® e.V. <http://www.aixcape.org>`_ Support and feedback by 12 :ref:`industrial partners <project-partners>` from Belgium, France, and Germany is greatly acknowledged. Overview ======== Algorithms ---------- Algorithms such as :doc:`/Algorithms/BackwardDifference/index` and :doc:`/Algorithms/HoltWintersDoubleExponentialSmoothing/index` are the foundation to solve many data processing tasks. Algorithms can be accessed in three different ways: .. toctree:: :maxdepth: 1 :hidden: Algorithms/index WorkProcessClassifiers/index Tools/index - :doc:`/Algorithms/index`: An alphabetical list of algorithms. - :doc:`/WorkProcessClassifiers/index`: Algorithms classified by basic properties, for example :doc:`/WorkProcessClassifiers/OneDimensionalAlgorithm/index` and :doc:`/WorkProcessClassifiers/MultiDimensionalAlgorithm/index`. - :doc:`/Tools/index`: Algorithms grouped by implementing tools, for example :doc:`/Tools/ExcelTool/index` and :doc:`/Tools/MatlabTool/index`. Single Steps ------------ Single steps provide a task-oriented view on data processing. They are arranged in a hierarchy of tasks, for example :doc:`/DataPreprocessing/index` → :doc:`/DataPreprocessing/DataCleaning/index` → :doc:`/DataPreprocessing/DataCleaning/HandlingImproperValues/index` → :doc:`/DataPreprocessing/DataCleaning/HandlingImproperValues/ReconstructingImproperValues/index`. The lowest level in the hierarchy contains the actual single steps, typically identified by an algorithm, for example :doc:`/DataPreprocessing/DataCleaning/HandlingImproperValues/ReconstructingImproperValues/ReconstructingImproperValuesWithLocalCenteredMovingMedian/index`. .. toctree:: :maxdepth: 1 :hidden: DataPreprocessing/index SingleStepClassifiers/index - :doc:`/DataPreprocessing/index`: Hierarchy of single steps. - :doc:`/SingleStepClassifiers/index`: Single steps classified by basic properties, for example :doc:`/SingleStepClassifiers/OutlierResistantStep/index`. Reference Processes ------------------- Reference processes are best practice procedures for more complex tasks from literature or provided by our project partners. .. toctree:: :maxdepth: 1 :hidden: ReferenceProcesses/index - :doc:`/ReferenceProcesses/index`: List of reference processes. Feedback ======== Users of the compendium are invited to send feedback and suggestions for improvement to *info(at)aixcape.org* (replace *(at)* with *@*). .. _project-partners: Project Partners ================ - `aiXtrusion GmbH <http://aixtrusion.de>`_ - Bayer Technology Services GmbH (now `Bayer AG <http://www.bayer.com>`_) - `BLANCO CS GmbH + Co KG <http://www.blanco-professional.com/>`_ - `Computing in Technology (CiT) GmbH <http://www.cit-wulkow.de>`_ - `engineo GmbH <http://www.engineo.com>`_ - `Evonik Industries AG <http://www.evonik.com/>`_ - `HiTec Zang GmbH <http://www.hitec-zang.de>`_ - `IPCOS NV <https://ipcos.com>`_ - `LeiKon GmbH <https://www.leikon.de>`_ - `m2p-labs GmbH <http://www.m2p-labs.com>`_ - `Total S.A. <http://www.total.com>`_ - `umesoft GmbH <http://www.umesoft.de>`_ Acknowledgment ============== .. image:: logo_funding_bmwi.* :align: center Das IGF-Vorhaben Nr. 16901 N der Forschungsvereinigung DECHEMA e.V., Theodor-Heuss-Allee 25, 60486 Frankfurt am Main, wurde über die AiF im Rahmen des Programms zur Förderung der industriellen Gemeinschaftsforschung und -entwicklung (IGF) vom Bundesministerium für Wirtschaft und Energie aufgrund eines Beschlusses des Deutschen Bundestages gefördert. The IGF project 16901 N of the research association DECHEMA e.V., Theodor-Heuss Allee 25, 60486 Frankfurt am Main, Germany, has been funded via AiF within the program for industrial joint research and development (Industrielle Gemeinschaftsforschung und -entwicklung, IGF) by the German Federal Ministry of Economics and Energy based on a resolution of the German Federal Diet. Changelog ========= .. toctree:: :maxdepth: 1 :hidden: Changelog A list of recent changes in the compendium is available :doc:`here <Changelog>`. License ======= The *Data Processing Compendium* is licensed under a `Creative Commons Attribution-ShareAlike 3.0 Unported License <http://creativecommons.org/licenses/by-sa/3.0>`_. .. image:: https://i.creativecommons.org/l/by-sa/3.0/88x31.png :alt: Creative Commons License :target: http://creativecommons.org/licenses/by-sa/3.0 Legal Information ================= See `Legal Information (Impressum) <http://www.aixcape.org/impressum>`_ at `www.aixcape.org <http://www.aixcape.org>`_.