Azure Data Engineer - SC Cleared
Posted Today by Infoplus Technologies UK Limited
Negotiable
Undetermined
Undetermined
London Area, United Kingdom
Summary: The Azure Data Engineer role requires a seasoned professional with over 10 years of experience in data engineering, specifically with a strong focus on Azure Databricks. The position demands expertise in data architecture, data integration, and proficiency in programming languages such as Python and Spark. The candidate should also have a solid understanding of data warehousing principles and experience with Azure data services.
Key Responsibilities:
- Design and implement data architecture and data pipelines using Azure Databricks.
- Optimize data pipelines for performance and efficiency.
- Work with large datasets and complex data integration patterns.
- Ensure data quality and governance processes are adhered to.
- Collaborate with cross-functional teams using Agile methodologies.
- Utilize version control systems for code management.
Key Skills:
- 10+ years of experience in data engineering.
- 3+ years of hands-on experience with Azure Databricks.
- Proficiency in Python and Spark (PySpark) or Scala.
- Deep understanding of data warehousing principles and data modelling techniques.
- Extensive experience with Azure data services (Data Factory, Blob Storage, SQL Database).
- Experience with SQL and NoSQL databases.
- Knowledge of data quality and governance processes.
- Experience with version control systems (e.g., Git).
- Familiarity with Agile development methodologies.
Salary (Rate): undetermined
City: London Area
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Essential Skills & Experience: 10+ years of experience in data engineering, with at least 3+ years of hands-on experience with Azure Databricks. Good proficiency in Python and Spark (PySpark) or Scala. Deep understanding of data warehousing principles, data modelling techniques, and data integration patterns. Extensive experience with Azure data services, including Azure Data Factory, Azure Blob Storage, and Azure SQL Database. Experience working with large datasets and complex data pipelines. Experience with data architecture design and data pipeline optimization. Proven expertise with Databricks, including hands-on implementation experience and certifications. Experience with SQL and NoSQL databases. Experience with data quality and data governance processes. Experience with version control systems (e.g., Git). Experience with Agile development methodologies.