Summary: TrueNorth is seeking a Staff Data Engineer for a fully remote, initial 6-month contract with potential for extension. The role requires significant experience in cloud-based data lake architectures and workflow orchestration, along with a strong background in building scalable data pipelines. The position is outside IR35 and is open to candidates with the right to work in the UK.

Key Responsibilities:

• Design and scale cloud-based data lake architectures, preferably Delta Lake on Databricks.
• Orchestrate workflows using Airflow, managing production-grade DAGs and dependencies.
• Build reliable and scalable batch and streaming data pipelines using Spark, Python, and SQL.
• Implement data quality, observability, and lineage systems across distributed environments.
• Lead technical design, platform adoption, and mentor engineers on best practices.

Key Skills:

• Significant experience with cloud-based data lake architectures.
• Deep expertise in workflow orchestration using Airflow.
• Strong background in building batch and streaming pipelines using Spark, Python, and SQL.
• Hands-on experience with data quality and observability systems.
• Proven leadership and mentoring skills in technical design and best practices.

Salary (Rate): undetermined

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT