Azure Databricks Engineer
Posted 1 week ago by ValueMomentum
Negotiable
Undetermined
Undetermined
England, United Kingdom
Summary: The Azure Databricks Engineer will design and develop modern data solutions with a focus on cloud-native platforms and architecture. The role requires extensive experience in data ingestion, processing, and analytical pipelines, particularly within the insurance domain. Candidates should have hands-on experience with Microsoft Azure services and a strong understanding of data delivery and architecture principles. Professional certifications in public cloud and tooling are highly desired.
Key Responsibilities:
- Design and develop modern data solutions on cloud-native platforms.
- Implement data ingestion, processing, and analytical pipelines for big data and relational databases.
- Utilize Microsoft Azure services including Azure Data Lake Storage, Azure Databricks, and Azure Data Factory.
- Integrate, model, and transform data within the insurance domain.
- Work with Agile delivery frameworks and tools such as Jira and AzureDevOps.
- Address data quality, master data management, and security challenges.
- Communicate effectively and collaborate within a team environment.
Key Skills:
- 12+ years of experience in data ingestion, processing, and analytical pipelines.
- 4+ years of hands-on experience with Microsoft Azure services.
- Proficiency in SQL, Python, and ETL tooling (e.g., Informatica IICS, ADF).
- Experience with data modeling concepts and data production processes.
- Knowledge of data delivery architecture principles.
- Professional certifications in Databricks and Azure.
- Strong verbal and written communication skills.
Salary (Rate): undetermined
City: undetermined
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: Other
We are seeking an experienced Azure Databricks Engineer to design and develop modern data solutions, focusing on cloud-native platforms and architecture. 12+ years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases. Over 4 years of hands-on experience with Microsoft Azure services, including Azure Data Lake Storage (ADLS), Azure Databricks, Azure Data Factory, Azure Synapse Analytics, and Azure SQL Database. Extensive hands-on experience in SQL, Python, Data Integration/Ingestion and associated patterns - ETL tooling – Informatica IICS, ADF, Notebooks, Databricks, Delta Lake, Warehousing technologies and associated patterns, Cloud platforms – Azure preferred. Proven experience in integrating, Modeling, and transforming Insurance domain data, ideally within Lloyd’s, specialty or insurance/reinsurance market. Experience with on-prem and cloud versions of databases such as Oracle and SQL Server. Experience with Agile delivery frameworks/methodologies (e.g. Scrum, SAFe) and tools (i.e. Jira, AzureDevOps). Experience with mass ingestion capabilities and cloud process flows, data quality and master data management Understanding data related security challenges and tooling with specific technologies (e.g. Databricks) Experience and in-depth knowledge of data delivery and associated architecture principles, data modelling concepts, and all steps of data production process Advanced verbal and written communications skills, as well as active listening, along with teamwork. Professional certifications in public cloud and tooling – Databricks and Azure are highly desired.
About ValueMomentum ValueMomentum is a leading solutions provider for the global property & casualty insurance industry, supported by deep domain and technology capabilities. We offer a comprehensive suite of advisory, development, implementation, and maintenance services across the entire P&C insurance value chain. This includes Underwriting, Claims, Distribution, and more, empowering insurers to stay ahead with sustained growth, high performance, and enhanced stakeholder value. Trusted by over 75 insurers, ValueMomentum is one of the largest standalone insurance-focused solutions providers to the US insurance industry.