Summary: The Data Engineer role requires a security-cleared professional to design and implement data ingestion pipelines, ensuring data quality and consistency. The position involves building and optimizing data flows, managing databases, and deploying data infrastructure primarily on AWS. Collaboration with data analysts and scientists is essential to deliver high-quality data solutions. Frequent travel to Northern Ireland is expected for UK-based candidates.

Key Responsibilities:

• Design and implement efficient data ingestion pipelines to and from databases and file storage services.
• Transform data from source to target to ensure data quality and consistency, based on agreed specifications.
• Build, maintain, and optimize data pipelines to automate data flows and enable real-time data processing.
• Monitor data quality and implement measures to ensure data accuracy and completeness.
• Manage and maintain databases to ensure optimal performance and security.
• Deploy and manage data infrastructure on cloud platforms – primarily AWS.
• Work closely with data analysts, data scientists, and other stakeholders to understand their data needs and deliver high-quality data solutions.

Key Skills:

• AWS focused, ideally an AWS Certified Data Engineer.
• SQL, Python, and Spark with experience in metadata-driven ETL/ELT.
• AWS Glue, Databrew, S3, AWS Lambda, PostgreSQL, Quicksight.
• Version Control (Gitlab), CI/CD, and IaC.
• Familiarity with security and networking principles, especially in AWS deployment.
• Experience in handling both structured and unstructured data.
• Complex data migrations.
• Strong problem-solving analytical skills.
• Excellent communication and collaboration skills.
• Understanding of GIS data models.

Salary (Rate): undetermined

City: Belfast

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT