Full stack Microsoft Azure Data Engineer/Developer
Posted 1 week ago by Experis UK
Negotiable
Inside
Remote
City Of London, England, United Kingdom
Summary: The role of Full Stack Microsoft Azure Data Engineer/Developer involves hands-on development and optimization of Databricks data pipelines, focusing on data engineering best practices. The candidate will work remotely and is expected to have strong expertise in Git/DevOps integration, Unity Catalog, and performance optimization. This position is classified as inside IR35 and requires collaboration with data engineers and architects to design scalable solutions. The role emphasizes adherence to best practices in data engineering within the Microsoft Azure ecosystem.
Key Responsibilities:
- Develop and optimize Databricks data pipelines for efficient data transformation.
- Implement code version management using Git and DevOps integration.
- Configure and manage Unity Catalog for secure and scalable data governance.
- Enhance performance optimization in Databricks workloads, ensuring efficient resource utilization.
- Collaborate with data engineers and architects to design scalable solutions.
- Ensure adherence to best practices in Databricks data engineering.
Key Skills:
- Hands-on experience with Microsoft Databricks and Apache Spark.
- Strong knowledge of Git, DevOps integration, and CI/CD pipelines.
- Expertise in Unity Catalog for data governance and security.
- Proven ability to optimize Databricks data transformation workloads.
- Experience with Azure Data Lake, Delta Lake, and cloud-based data solutions.
Salary (Rate): undetermined
City: City Of London
Country: United Kingdom
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT