Summary: The Data Engineer role involves leading the development of a scalable and compliant data platform for a Manchester-based client on a 6-month contract. The position requires modernizing existing data solutions and ensuring high-quality data for analysis through collaboration and advanced technologies. The candidate will be responsible for data quality, security, and governance while promoting best practices within the engineering teams. Strong experience in building big data pipelines and a passion for continuous improvement are essential for success in this role.

Key Responsibilities:

• Collaborate with business users to design and implement efficient, secure, and scalable data pipelines using standardized tools and procedures.
• Troubleshoot and resolve data pipeline issues, perform root cause analysis, and implement enhancements to prevent recurrence.
• Take full ownership of the data quality within core datasets and pipelines.
• Work with other teams to identify and resolve data quality issues.
• Ensure data is complete, accessible, and consumable in a fast-paced development environment.
• Maintain data security, integrity, and governance by adhering to company standards and best practices.
• Promote data quality, governance, and security within product and engineering teams.
• Contribute to and evolve best practices for architecture, quality, and non-functional requirements.
• Experiment with new tools and technologies to enhance engineering excellence.
• Design, build, test, and support high-quality code in line with departmental guidelines and testing strategies.

Key Skills:

• 5+ years of experience building big data pipelines in distributed environments using tools such as Kafka, Hadoop, Spark, Python, and DBT.
• Strong data modeling skills (e.g., Dimensional, Data Vault).
• Passionate about Continuous Integration, Continuous Delivery, and Agile methodologies.
• Solid understanding of security principles and secure coding practices.
• Experience with large-scale, well-governed, and compliant systems.
• Proven ability to lead, guide, and coach team members both technically and procedurally.
• Basic knowledge of analytics and machine learning concepts.
• Excellent communication skills, both written and verbal.
• Understanding of cloud security best practices.
• Experience with cloud platforms, preferably AWS.

Salary (Rate): £600

City: Manchester

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT