Data Engineer - AWS

Summary: Join a dynamic data engineering team as a Senior Data Engineer, focusing on architecting, delivering, and optimizing modern data pipelines on AWS. The role involves developing scalable solutions, driving best practices, and mentoring junior engineers in a collaborative environment. The position requires extensive experience in data engineering applications and AWS services. The role is based in Manchester with a pay rate of £360 per day.

Key Responsibilities:

• Architect, deliver, and optimize modern data pipelines on AWS.
• Develop scalable solutions and drive best practices.
• Mentor junior engineers within a collaborative trunk-based development environment.
• Build CI/CD workflows using GitHub Actions.
• Utilize orchestration tools like Airflow for data workflows.
• Ensure adherence to coding standards and maintain clean, maintainable code.
• Conduct unit testing using pytest.
• Collaborate through pair programming and peer reviews.

Key Skills:

• 7+ years hands-on experience in Python and PySpark for data engineering applications.
• Deep expertise in AWS services, especially Redshift, Glue, Lambda, and Step Functions.
• Proficient in building CI/CD workflows using GitHub Actions.
• Orchestration experience with Airflow or similar tools.
• Strong command of SQL, including performance optimization and data modeling.
• Solid understanding of infrastructure as code, preferably with Terraform.
• Experience with Docker for development and testing environments.
• Knowledge of Oracle and Qlik Replicate/Compose for source data systems.
• Familiarity with RBAC models and secrets management.
• Unit testing experience using pytest.
• Comfortable with Visual Studio Code as primary IDE.

Salary (Rate): £360 per day

City: Manchester

Country: UK

Working Arrangements: on-site

IR35 Status: inside IR35

Seniority Level: Senior

Industry: IT