Summary: The Senior Data Engineer role is focused on enhancing a SaaS platform that supports financial services and legal institutions through the development of scalable data solutions. The position requires expertise in AWS and involves optimizing ETL processes, ensuring data governance, and collaborating with various teams. This is a contract position with a hybrid working arrangement based in London. The role is classified as outside IR35.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines and architectures.
• Optimise ETL processes for managing large-scale regulatory and onboarding datasets.
• Collaborate with data scientists, analysts, and engineers to ensure efficient data flows.
• Implement best practices in data governance, security, and compliance.
• Develop and maintain AWS cloud-based data infrastructure.
• Ensure the integrity and performance of real-time and batch data processing systems.

Key Skills:

• Strong experience in Python, SQL, and Spark.
• Expertise in data warehousing, ETL pipelines, and big data technologies.
• Hands-on experience with AWS services (Glue, Redshift, Lambda, S3, etc.).
• Knowledge of CI/CD pipelines and Infrastructure as Code (Terraform, CloudFormation).
• Understanding of financial and legal data regulations (e.g., GDPR, FCA compliance).

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: Senior

Industry: Finance