We are currently looking for Data Expert experienced in Azure Databrick (m/f/d)

Start: 23.01.2025
Volume: ca. 60 days (3 months duration)
Location: remote

Project:
Client aims to transforming their purchasing function further into a world-class operating model powered by digital technologies.One initiative of the overall program is the N4T Databased Backbone (N4T DBB) Initiative. N4T Database Backbone aims to improve the purchasing organization by enhancing data management and utilization, integrating multiple internal and external data sources with N4T applications.

Tasks (independent delivery):
Data Integration & Connection: Connections between the Data Platform (HDP) and various internal and external source systems should be established to enable the client to have a unified, structured view of data, which is crucial for informed decision-making
Data Governance & Quality Management: The client can secure data governance by maintaining the data catalogue, ensuring data can be used compliantly, and ownership is documented. Data quality will be properly managed, which includes automated and systematic measurements, definition of clear accountabilities, and automated updates to data quality dashboards (via e.g. the FP Quality Dashboard)
Centralized Data Management: Make use of the existing central data management of the HDP and utilize that for purchasing data, which includes both internal data and external market data.
Data Preparation and Provisioning: Once data sources are integrated into the system, those should be modelled accordingly. To achieve that, the objective of individual other N4T use cases needs to be understood. Development, application, and testing of analytical logic are essential to leverage use case capabilities.

Data Integration and Connection: Consulting of establishing robust connections between the Data Platform (HDP) and various (~50) external and internal source systems, provision of professional consulting regarding a seamless flow and further usage of the data sources in related N4T projects.
Data Governance and Quality Management: Making use of existing client Data Governance processes so that data is stored compliantly, the ownership is documented and high data quality through automated measurement

Data Preparation and Provisioning:
- Consulting of model integrated data sources to meet various N4T use case s needs; developing, applying, and testing analytical logic, and preparing of templates to leverage use case capabilities fully.

Skills:
- English is required
- 3-5 years professional experience (the more the better)
- Experience in Data Integration and Connection / Data Governance and Quality Management Data Preparation and Provisioning
- Expert Knowledge in Azure Databricks
- Python, PySpark, Azure DevOps, SQL
- Experience in architecture design/data models to design/implement connections to various source systems
- Experience with building API s or connecting to API s
- Experience in using Data Governance processes
- IT Security Knowledge
- Expertise in building state of the art data products and pipelines, validating use cases, end-user workflows and analytical processes

we are excited to hear from you

Michael Bailey International is acting as an Employment Business in relation to this vacancy.