AWS Data Engineer (Spark/Python/SQL)
Posted Today by Robert Walters
£650 Per day
Inside
Remote
England, UK
Summary: The AWS Data Engineer role focuses on designing, developing, and maintaining data pipelines and solutions using Spark, Python, and SQL for a leading global client. This position is part of a 6-12 month decommissioning program and requires remote work with some travel to client sites. Candidates must have a valid right to work in the UK and will be classified as inside IR35. The role offers a competitive daily rate based on experience.
Key Responsibilities:
- Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores.
- Build and maintain data warehousing and data lake solutions.
- Develop and deploy data models that support various business requirements.
- Write efficient and scalable code in languages such as Python.
- Lead the design of data solutions with quality, automation, and performance in mind.
- Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable.
- Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption.
- Work with Data Governance team to ensure solutions are compliant with regulations such as GDPR and CISO policies and data quality is baked-in to pipelines.
- Maintain and optimise existing data pipelines to improve performance and quality, minimising impacts to business.
- Collaborate with cross-functional teams to understand data requirements and provide support for data-driven initiatives.
Key Skills:
- 5 years+ experience in data engineering.
- Experience with AWS cloud technologies.
- Python.
- Advanced SQL.
- Spark/PySpark.
- Experience in working in a highly regulated environment/industries.
- Experience with data governance frameworks.
- Understanding of incremental data processing and versioning.
- Understanding of RESTful APIs and web technologies.
Salary (Rate): £650.00 per day
City: undetermined
Country: UK
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Detailed Description From Employer:
AWS Data Engineer (Spark/Python/SQL)
6-month durations
Remote with some travel to client sites
Rates: £500-650 per day (DoE)
Inside IR35 (payroll via Umbrella Co.)
Start dates in Late Feb - Mar - Early April
Applicants must have valid right to work in UK
AWS Data Engineer (Spark/Python/SQL) contractors (8+ hires) required for a leading global client as part of a 6-12-month decommissioning programme
Responsibilities:
- Design, develop, and maintain data pipelines for collecting, transforming, and loading data into various data stores.
- Build and maintain data warehousing and data lake solutions
- Develop and deploy data models that support various business requirements
- Write efficient and scalable code in languages such as Python
- Lead the design of data solutions with quality, automation, and performance in mind
- Own the data pipelines feeding into the Data Platform ensuring they are reliable and scalable
- Ensure data is available in a fit-for-purpose and timely manner for business and analytics consumption
- Work with Data Governance team to ensure solutions are compliant with regulations such as GDPR and CISO policies and data quality is baked-in to pipelines
- Maintain and optimise existing data pipelines to improve performance and quality, minimising impacts to business
- Collaborate with cross-functional teams to understand data requirements and provide support for data-driven initiatives
Applicants must have the following skills & experience
- 5 years+ experience in data engineering
- Experience with AWS cloud technologies
- Python
- Advanced SQL
- Spark/PySpark
- Experience in working in a highly regulated environment/industries
- Experience with data governance frameworks
- Understanding of incremental data processing and versioning
- Understanding of RESTful APIs and web technologies
If interested in this AWS Data Engineer (Spark/Python/SQL) role please apply with latest WORD cv clearly showing suitability to this role.
Applicants must have RTW in UK and No Sponsorship is available.
Robert Walters Operations Limited is an employment business and employment agency and welcomes applications from all candidates