Summary: The Azure Data Engineer role is a fully remote position focused on engaging with data leads, scientists, and analysts to develop and implement data analytics and insights. The engineer will analyze raw data, refine reporting requirements, and create data models while ensuring adherence to data standards and best practices. Immediate start is required, and candidates must have security clearance. The role involves significant collaboration with various stakeholders to drive data transformation and orchestration.

Key Responsibilities:

• Analyse raw data (mostly in JSON format) for data parsing, schema evolution, and transformation towards metric development.
• Analyse reporting/metric requirements from a data engineering perspective for refinement, estimation, development, and deployment.
• Work closely with analysts and data scientists to understand business requirements, data sources, and logic for metric development.
• Create normalized/dimensional data models based on requirements.
• Translate and refine notebooks and logic developed as part of prototypes.
• Transform data from landing/staging/transformed to synapse dimensional model.
• Create notebooks in Databricks for incremental data load and transformation.
• Create stored procedures for data load and transformation in Azure Synapse dedicated pools.
• Create ADF pipelines for data orchestration across different data layers of Databricks and Synapse.

Key Skills:

• Experience with Azure Data Factory (ADF) and Azure Synapse.
• Proficiency in data modeling and ETL processes.
• Strong understanding of JSON data format and data transformation techniques.
• Ability to create and manage notebooks in Databricks.
• Experience in creating stored procedures for data manipulation.
• Strong analytical and problem-solving skills.
• Excellent communication and collaboration skills.
• Security clearance.

Salary (Rate): 450

City: undetermined

Country: UK

Working Arrangements: remote

IR35 Status: inside IR35

Seniority Level: Senior

Industry: IT