Lead AWS Data Engineer
Posted 4 days ago by Tenth Revolution Group
£650 Per day
Inside
Hybrid
Northampton, Northamptonshire
Summary: The Lead Data Engineer role is a contract position based in Northampton, requiring a proficient individual with over 7 years of experience in developing complex data pipelines using PySpark in AWS. The candidate will lead a team while designing ETL processes and ensuring data security. The role involves collaboration with various teams to meet data analysis and business requirements. This position is classified as inside IR35 and requires hybrid working, with 2 to 3 days in the office each week.
Key Responsibilities:
- Lead the development of complex data pipelines using PySpark in AWS.
- Design and implement ETL processes while ensuring data security.
- Collaborate with other teams for data analysis and business requirements.
- Provide guidance and support to team members.
- Utilize AWS services such as S3, Redshift, EMR, Glue, and Kinesis for scalable data solutions.
Key Skills:
- Proficient in PySpark, Glue, Python, SQL, and data processing.
- 7+ years of experience in data engineering and pipeline development.
- Strong understanding of AWS services and data security practices.
- Experience in designing scalable and efficient data solutions.
Salary (Rate): £650/day
City: Northampton
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
Lead Data Engineer - Contract
Location: Northampton (hybrid - need to be in office 2/3 days in a week)
Duration: 6 months
Inside IR35
Job description:
This will be a Tech Lead who is proficient in developing complex logic using pyspark in AWS along with helping/leading the team.
7+ years of experienced in designing, developing complex logic for data pipelines using pyspark in AWS along with helping/leading the team.
He/she needs to experienced and skilled in PySpark, Glue, Python, SQL and Data processing. This involves designing ETL processes, ensuring data security, and collaborating with other teams for data analysis and business requirements.
Skilled in scalable, reliable, and efficient data solutions, often using AWS services like S3, Redshift, EMR, Glue, and Kinesis.
Please send CV's to a.otoole@tenthrevolution if you meet each requirement