Lead Data Platform Engineer
Posted Today by Harvey Nash
Negotiable
Inside
Onsite
London
Summary: The Lead Data Platform Engineer will oversee the development and maintenance of a cloud-based data platform on Google Cloud Platform (GCP), focusing on data operations and analytics. This role involves mentoring a team of data engineers and implementing best practices in data engineering and cloud infrastructure. The position is a 6-month contract requiring on-site work three days a week and is classified as inside IR35.
Key Responsibilities:
- Lead data engineering and GCP cloud engineering best practices.
- Architect and manage cloud infrastructure, ensuring security, scalability, and cost efficiency.
- Maintain and enhance a lakehouse architecture with BigQuery at its core.
- Oversee data orchestration using Airflow/Cloud Composer and integrations with tools like Fivetran, Tableau, and Alation.
- Optimize cost management and performance monitoring across all data tools.
- Drive best practices in CI/CD, Terraform, and DevOps methodologies.
- Collaborate with architects, product managers, and stakeholders to align technical roadmaps with business goals.
Key Skills:
- Expertise in GCP (BigQuery, Kubernetes, DataProc).
- Strong coding skills in Python, Airflow, and DBT.
- Experience with CI/CD, Terraform, and cloud security best practices.
- Knowledge of Fivetran, BigQuery Transfers, and Spark/Scala is a plus.
- Ability to mentor engineers, communicate effectively, and drive strategic decisions.
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT