Summary: The role of SC Cleared Azure Data Engineer involves working with a government client to develop and implement data analytics and insights. The position requires active Security Clearance and focuses on collaborating with data leads, scientists, and analysts to enhance data processes. The engineer will be responsible for data transformation, orchestration, and modeling using Azure services and Databricks. This is a fully remote position for a 3-month contract with potential for extension.

Key Responsibilities:

• Analyse raw data for parsing, schema evolution, and transformation towards metric development.
• Assess reporting and metric requirements from a data engineering perspective for refinement and deployment.
• Collaborate with analysts and data scientists to understand business requirements and data sources.
• Create normalized/dimensional data models based on requirements.
• Translate and refine notebooks and logic developed as part of prototypes.
• Transform data from various stages to a synapse dimensional model.
• Create notebooks in Databricks for incremental data load and transformation.
• Develop stored procedures for data load and transformation in Azure Synapse dedicated pools.
• Create ADF pipelines for data orchestration across different data layers.

Key Skills:

• Strong experience with Azure data services such as ADF, Synapse, SQL, and ADB.
• Proficient in Databricks notebooks development for data ingestion, validation, and transformation.
• Strong skills in PySpark and SQL.
• Experience in ADF pipeline development and data orchestration techniques.
• Strong background in stored procedure development.
• Good knowledge of dimensional data modeling and Power BI reporting.

Salary (Rate): 455

City: undetermined

Country: UK

Working Arrangements: remote

IR35 Status: inside IR35

Seniority Level: Senior

Industry: IT