Senior Data Engineer
Posted 2 weeks ago by 1750401883
Negotiable
Inside
Hybrid
UK (Remote)
Summary: The role of Senior Data Engineer at WA Consultants involves managing cloud-based extract and load processes, primarily within an AWS environment. The position is for an initial 6-month contract and requires collaboration with business stakeholders and cross-functional teams. The successful candidate will be responsible for designing and developing data pipelines while ensuring practices align with the latest developments in data engineering. This role is classified as inside IR35 and offers a hybrid working arrangement with on-site expectations in Canary Wharf.
Key Responsibilities:
- Manage cloud-based extract and load processes, ideally on AWS.
- Design and develop data pipelines.
- Work with business stakeholders and cross-functional teams.
- Ensure practices are up to date with the latest developments in data engineering.
- Build CI/CD workflows, ideally with GitHub Actions.
- Utilize orchestration tools, ideally Airflow.
- Implement infrastructure as code, ideally Terraform.
Key Skills:
- Excellent Python, SQL, and Jinja skills.
- Experience with cloud platforms, ideally AWS.
- Experience with orchestration tools, ideally Airflow.
- Experience in building CI/CD workflows, ideally with GitHub Actions.
- Experience in designing and developing data pipelines.
- Experience working with business stakeholders and cross-functional teams.
- Experience with infrastructure as code, ideally Terraform.
Salary (Rate): undetermined
City: Canary Wharf
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
WA Consultants is currently recruiting for a Senior Data Engineer for an initial 6-month contract.
The successful applicant will be experienced in cloud based extract and load processes, ideally on an AWS estate.
Essential Requirements:
* Excellent python, SQL and jinja skills
* Experience with cloud platforms, ideally AWS
* Experience of orchestrations tools, ideally airflow
* Experience of building CI/CD workflows, ideally with GitHub Actions
* Experience of ensuring practices are up to date with latest developments in data engineering
* Experience of designing and developing data pipelines
* Experience of working with business stakeholders and cross-functional teams
* Experience of infrastructure as code, ideally Terraform
Please note, the role has been deemed by the client to fall inside of IR35. This is a hybrid working position with the expectation of 2-3 days on site per week at the client office in Canary Wharf.
For further information, please contact Alexander Wilson.
WA Consultants is an Employment Business and an Employment Agency as described within The Conduct of Employment Agencies and Employment Businesses Regulations 2003.