Summary: The Senior AWS Data Engineer will play a crucial role in designing, developing, and maintaining scalable data pipelines and solutions within a dynamic team. This position requires substantial experience in data engineering, focusing on data quality, integration, and innovative solutions using modern data technologies. The role involves collaboration with cross-functional teams to support analytics and business intelligence initiatives. The ideal candidate will have a strong background in cloud services, particularly AWS, and a deep understanding of data governance and management practices.

Key Responsibilities:

• Design, build, and maintain efficient data pipelines using tools such as AWS Glue, Apache Airflow, PySpark, AWS DMS, CDC or similar.
• Develop and optimize PySpark and SQL based ETL/ELT processes for data integration and transformation.
• Manage cloud-based data platform such as AWS using Terraform and implement best practices for data governance, security, and reliability.
• Collaborate with stakeholders to define requirements and deliver scalable data solutions.
• Implement and manage real-time streaming processes using technologies such as Apache Kafka, Apache Spark, or similar tools.
• Support and enhance data architecture, including data lakes, data warehouses, and data marts.
• Drive improvements in data quality, data governance, and metadata management practices.
• Contribute to automation and monitoring processes for data pipelines to ensure operational excellence.

Key Skills:

• Bachelor’s degree in Computer Science, Data Science, Engineering, or a related field.
• 8+ years of experience in data engineering, including designing and deploying production-quality data pipelines and ETL/ELT solutions.
• Proficiency in Python, PySpark and SQL.
• Strong hands-on experience with cloud services such as AWS (Glue, Lambda, Redshift, S3).
• Experience with data governance and management platforms (e.g., AWS DataZone, AWS Lake Formation).
• Familiarity with containerization and orchestration technologies (Docker, Kubernetes) is a plus.
• Exceptional analytical and problem-solving skills.
• Strong communication and collaboration capabilities.

Salary (Rate): undetermined

City: London Area

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: Senior

Industry: IT