Data Engineer
Posted 7 days ago by SThree Management Services on CVLibrary
£550 Per day
Undetermined
Undetermined
Manchester, Greater Manchester
Summary: The Data Engineer role requires a candidate with extensive hands-on experience in Databricks, Azure Data Factory, Python, and DBT. The position involves developing data models, troubleshooting pipelines, and automating ETL workflows to enhance machine learning features. Effective communication skills are essential for articulating technical decisions clearly to stakeholders. The role emphasizes delivering production-ready code and adhering to best practices in data governance and performance.
Key Responsibilities:
- Develop and maintain SQL models and macros using DBT
- Collaborate with stakeholders to gather and refine modelling requirements
- Debug and enhance existing data models
- Design and implement ETL/ELT workflows and data pipelines using Azure Data Factory
- Automate ETL workflows to support machine learning features
- Apply best practices for data governance, quality, and performance
- Utilise Azure Databricks and adhere to code-based deployment practices
Key Skills:
- Over 3 years of experience with Databricks (including Lakehouse, Delta Lake, PySpark, Spark SQL)
- Strong proficiency in SQL with 5+ years of experience
- Extensive experience with Azure Data Factory
- Proficiency in Python programming
- Excellent stakeholder/client-facing communication abilities
Salary (Rate): £550
City: Manchester
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT