Summary: The Data Engineer role involves designing and implementing data ingestion pipelines, transforming data to ensure quality, and managing databases for optimal performance. The position requires collaboration with data analysts and scientists to deliver high-quality data solutions, primarily utilizing AWS for data infrastructure. Candidates must be willing to travel frequently to Northern Ireland if based in the UK. This is a 6-month contract position with a day rate of £500, classified as inside IR35.

Key Responsibilities:

• Design and implement efficient data ingestion pipelines to and from databases and file storage services.
• Transform data from source to target to ensure data quality and consistency, based on agreed specifications.
• Build, maintain and optimise data pipelines to automate data flows and enable real-time data processing.
• Monitor data quality and implement measures to ensure data accuracy and completeness.
• Manage and maintain databases to ensure optimal performance and security.
• Deploy and manage data infrastructure on cloud platforms – primarily AWS.
• Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.

Key Skills:

• AWS focused, ideally an AWS Certified Data Engineer.
• SQL, Python, and Spark with experience in metadata-driven ETL/ELT.
• AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
• Version Control (Gitlab), CI/CD and IaC.
• Familiar with security and networking principles, especially in AWS deployment.
• Experience and understanding of handling both structured and unstructured data.
• Complex data migrations.
• Strong problem-solving analytical skills.
• Excellent communication and collaboration skills.
• Understanding of GIS data models.

Salary (Rate): 500

City: Belfast

Country: Northern Ireland

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT