Data Engineer
Posted 1 week ago by Osmii
Negotiable
Undetermined
Hybrid
London Area, United Kingdom
Summary: The Azure Databricks Engineer role involves designing and building advanced data solutions on cloud-native platforms, specifically within Microsoft Azure. The position requires extensive experience in developing data pipelines and a strong understanding of data architecture. The ideal candidate will have a collaborative mindset and a passion for modern data technologies. This is a 6-month initial contract with hybrid working arrangements, requiring 3 days on-site in London.
Key Responsibilities:
- Design and build data solutions on cloud-native platforms.
- Develop data ingestion, processing, and analytical pipelines for big data and relational databases.
- Utilize core Microsoft Azure services including Azure Data Lake Storage, Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database.
- Implement data integration patterns using SQL, Python, and tools like Informatica IICS and Databricks notebooks.
- Manage data security challenges and solutions, particularly with Databricks.
- Collaborate with teams using Agile methodologies and tools like Jira and Azure DevOps.
- Oversee large-scale data ingestion, cloud process flows, data quality, and master data management.
Key Skills:
- 12+ years of experience in data engineering.
- 4+ years of hands-on experience with Microsoft Azure services.
- Extensive experience with SQL, Python, and data integration tools.
- Strong knowledge of Delta Lake and data warehousing technologies.
- Experience with on-premise and cloud databases (e.g., Oracle, SQL Server).
- Familiarity with Agile methodologies (Scrum, SAFe).
- Excellent verbal and written communication skills.
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Azure Databricks Engineer London (Hybrid working 3 days onsite) 6 months initial contract length We're looking for an experienced Azure Databricks Engineer to design and build cutting-edge data solutions on cloud-native platforms. If you have a passion for modern data architecture and a track record of success, we want to hear from you.
What You'll Bring:
- 12+ years of experience developing data ingestion, processing, and analytical pipelines for big data and relational databases.
- 4+ years of hands-on experience with core Microsoft Azure services, including:
- Azure Data Lake Storage (ADLS)
- Azure Databricks
- Azure Data Factory
- Azure Synapse Analytics
- Azure SQL Database
- Extensive experience with SQL, Python, and data integration patterns using tools like Informatica IICS and Databricks notebooks.
- Strong knowledge of Delta Lake, data warehousing technologies, and cloud platforms, with a strong preference for Azure.
- Experience with on-premise and cloud databases (e.g., Oracle, SQL Server).
- Familiarity with Agile methodologies (Scrum, SAFe) and tools (Jira, Azure DevOps).
- Experience with large-scale data ingestion, cloud process flows, data quality, and master data management.
Our Ideal Candidate
- A deep understanding of data security challenges and solutions, particularly with Databricks.
- In-depth knowledge of data delivery, architectural principles, data modeling concepts, and the entire data production process.
- Excellent verbal and written communication skills, with a collaborative, teamwork-oriented mindset.