Data Ingest
• Create pipelines, streams, processes, message brokers, agents, and code to retrieve information from different sources.
• Design and implement data storage of different types, depending on the source.
Data Transformation
• Data pre-processing, processing, transformation, normalization, and storage.
• Definition and implementation of highly parallelizable data transformation, normalization and filtering processes.
Data Inspection
• Implementation of tools for early data inspection.
• Design and implementation of data warehouses and other report-enabled databases.
• Create and maintain dashboards, control panels, and reports