Summary: The Data Engineer role at a public sector organization in Edinburgh involves ensuring the technical resiliency of data integration solutions and supporting ongoing data engineering activities. The position requires collaboration with technical colleagues to design robust solutions and emphasizes sustainable software development practices. This is a hybrid role with an initial 6-month contract and a daily rate of £484, classified as outside IR35.

Key Responsibilities:

• Ensure technical resiliency of all data integration solutions and services.
• Support the delivery of ongoing data engineering activities.
• Enhance and support existing data product outputs for both internal and external customers.
• Collaborate with technical colleagues to design robust data integration solutions.
• Demonstrate excellent, sustainable, and collaborative software development practices.
• Participate in team events, leading where specialist knowledge is required.
• Troubleshoot and fix development and production problems across multiple environments.
• Engage with wider communities of practice to share knowledge and experience.
• Ensure high quality of developed solutions through unit tests and code analysis.
• Ensure compliance with non-functional software requirements.
• Use collaborative development practices such as pairing and mobbing techniques.
• Support and deliver disaster recovery assurance of digital services.

Key Skills:

• Python
• PostgreSQL
• REST APIs
• Modern DevOps and CI/CD practices and tooling (Docker, GitLab CI, AWS CodePipeline, AWS CDK, AWS CloudFormation)
• Expertise in SQL, data transformation, and analysis
• Experience implementing data ETLs, data streaming systems, and data integration solutions
• Experience working in Agile delivery models (Scrum and/or Kanban)
• Data warehousing (desirable)
• Hybrid on-premises/cloud solutions (desirable)
• AWS Glue, Step Functions, Lambda functions, S3, RDS, Data Migration Service (desirable)
• Using testing tools for unit testing (desirable)
• Openshift (desirable)
• PostGIS for PostgreSQL (desirable)
• Designing and implementing service and event-based architectures (desirable)
• Monitoring, alerting, intelligence tools (desirable)
• Human-centred, research-driven, inclusive design practices (desirable)
• TDD (desirable)

Salary (Rate): 484

City: Edinburgh

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT