AWS / Databricks Platform Engineer - Outside IR35
Posted 1 day ago by ShareForce
£550 Per day
Outside
Remote
London Area, United Kingdom
Summary: The role of Platform Engineer involves supporting the rollout and operation of a large-scale Data and AI platform, focusing on building secure and scalable AWS infrastructure. Responsibilities include implementing governance and enabling advanced data services across various business domains. The position requires expertise in Terraform, CI/CD pipelines, and AWS security best practices. This is a remote role with occasional travel to the client site in London.
Key Responsibilities:
- Design, build, and maintain AWS infrastructure using Terraform (IaC).
- Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
- Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
- Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
- Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
- Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
- Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
- Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
- Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.
Key Skills:
- Proven experience delivering Terraform-based AWS infrastructure.
- Strong understanding of GitHub Actions and CI/CD automation.
- Hands-on expertise with AWS Private Link, VPC networking, and secure service exposure.
- Deep knowledge of Databricks and Unity Catalog for governance and security.
- Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
- Background in AWS IAM, federated authentication, OAuth, and identity integration.
- Proven ability to design with security, resilience, and cost-optimisation in mind.
- Excellent collaboration and documentation skills within cross-functional teams.
Salary (Rate): £550 daily
City: London
Country: United Kingdom
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
We are seeking an experienced Platform Engineer to support the rollout and ongoing operation of a large-scale, federated Data and AI platform. The role will focus on building secure, scalable, and cost-optimised AWS infrastructure, implementing governance, and enabling advanced data services across multiple business domains.
Key Responsibilities:
- Design, build, and maintain AWS infrastructure using Terraform (IaC).
- Develop, manage, and optimise CI/CD pipelines with GitHub Actions.
- Implement secure network connectivity using AWS PrivateLink (Interface VPC Endpoints) and VPC endpoint services.
- Configure and govern Databricks and Unity Catalog to ensure compliant data access and lineage.
- Enforce consistency and control through AWS Organizations, Service Control Policies (SCPs), AWS Config, and compliance frameworks.
- Manage identity and access management (IAM) using OAuth, federated credentials, and RBAC principles.
- Apply AWS security best practices, including Defense in Depth, BCDR, and high availability.
- Monitor and optimise cloud cost efficiency using AWS Cost Explorer, Budgets, and FinOps best practices.
- Collaborate with data, platform, and security teams to ensure a resilient, governed, and high-performing cloud ecosystem.
Required Skills & Experience:
- Proven experience delivering Terraform-based AWS infrastructure.
- Strong understanding of GitHub Actions and CI/CD automation.
- Hands-on expertise with AWS Private Link, VPC networking, and secure service exposure.
- Deep knowledge of Databricks and Unity Catalog for governance and security.
- Solid experience with AWS Organizations, SCPs, AWS Config, and resource governance.
- Background in AWS IAM, federated authentication, OAuth, and identity integration.
- Proven ability to design with security, resilience, and cost-optimisation in mind.
- Excellent collaboration and documentation skills within cross-functional teams.
Additional Information:
- Day Rate: Up to £550
- IR35 Status: Outside IR35
- Start Date: February
- Duration: Initial 3-month contract, significant opportunity for extension
- Location: Remote with occasional travel to client site (London)