Summary: The role of Solution Architect - Databricks involves working with a large consultancy on a 6-month contract in Milton Keynes, requiring a blend of on-site and remote work. The ideal candidate should possess extensive experience in Azure Databricks and related technologies, along with strong data engineering and solution architecture skills. The position emphasizes technical leadership and the ability to manage large-scale data pipelines in cloud environments. Candidates should be adept in performance optimization and scalable data processing architectures.
Key Responsibilities:
- Design and implement solutions using Azure Databricks.
- Lead technical architecture discussions and decisions.
- Manage large-scale structured and unstructured data pipelines.
- Optimize performance and scalability of data processing architectures.
- Collaborate with cross-functional teams to deliver data engineering solutions.
Key Skills:
- Strong experience in Azure Databricks.
- Proficiency in PySpark and Delta Lake.
- Experience with Azure Data Factory and Azure Synapse Analytics.
- Expertise in enterprise data engineering.
- Ability to work in cloud environments, preferably Azure.
Salary (Rate): undetermined
City: Milton Keynes
Country: UK
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Solution Architect - Databricks
My client, a large consultancy, is in need of a Solution Architect with experience in Databricks for a 6 month contract based in Milton Keynes offering 1 day per week remote but requiring 4 days per week on-site.
The ideal candidate will have strong experience in Azure Databricks, PySpark, Delta Lake, Azure Data Factory, Azure Synapse Analytics, and enterprise data engineering, coupled with solution architecture and technical leadership capabilities.
The ideal candidate will have strong experience in data engineering with strong exposure to Databricks and PySpark, Proven ability to handle large-scale structured and unstructured data pipelines, Experience working in cloud environments, preferably Azure, Exposure to performance optimisation and scalable data processing architectures.