Summary: The Data Engineer role based in Belfast, Northern Ireland, involves designing and implementing data ingestion pipelines, ensuring data quality, and managing cloud-based data infrastructure primarily on AWS. The position requires collaboration with data analysts and scientists to deliver high-quality data solutions. This is a 6-month contract role with a day rate of £500, classified as inside IR35. Frequent travel to Northern Ireland is expected for UK-based candidates.

Key Responsibilities:

• Design and implement efficient data ingestion pipelines to and from databases and file storage services.
• Transform data from source to target to ensure data quality and consistency based on agreed specifications.
• Build, maintain, and optimise data pipelines to automate data flows and enable real-time data processing.
• Monitor data quality and implement measures to ensure data accuracy and completeness.
• Manage and maintain databases to ensure optimal performance and security.
• Deploy and manage data infrastructure on cloud platforms, primarily AWS.
• Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.

Key Skills:

• AWS focused, ideally an AWS Certified Data Engineer.
• Proficient in SQL, Python, and Spark with experience in metadata-driven ETL/ELT.
• Familiarity with AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, and Quicksight.
• Experience with version control (Gitlab), CI/CD, and Infrastructure as Code (IaC).
• Understanding of security and networking principles, especially in AWS deployment.
• Experience handling both structured and unstructured data.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Understanding of GIS data models.

Salary (Rate): £500

City: Belfast

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT