Summary: A leading data-driven digital consultancy is seeking a Senior Data Engineer for a fully remote position focused on Databricks, Spark, and modern lakehouse architecture within AWS and Azure. The role involves building scalable data pipelines that impact business outcomes, collaborating with cross-functional teams, and contributing to a growing data and AI practice. This position is ideal for candidates looking for technical depth and client-facing opportunities in a dynamic environment. Applicants must be authorized to work in the US on a full-time basis.
Key Responsibilities:
- Build scalable data pipelines that impact business outcomes for large organizations.
- Collaborate with cross-functional teams across diverse industries.
- Work on meaningful, production-grade data solutions.
- Engage in hands-on data engineering tasks primarily using Databricks and Spark.
- Contribute to the development of data and AI practices within the organization.
Key Skills:
- 3+ years of experience in data engineering.
- Hands-on experience with Databricks and Delta Lake.
- Strong experience with Apache Spark (PySpark preferred).
- Advanced SQL skills for large-scale data transformation.
- Experience with cloud platforms (AWS or Azure).
- Experience building and maintaining production data pipelines.
- Understanding of data modeling and lakehouse architectures.
Salary (Rate): £56.00 hourly
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
A leading data-driven digital consultancy is hiring a Senior Data Engineer for a fully remote, full-time opportunity. This organization works at the cutting edge of AI, analytics, and cloud technology, helping enterprise clients unlock value from complex datasets. This role is centered around Databricks, Spark, and modern lakehouse architecture within AWS and Azure ecosystems.
This is an opportunity to work on meaningful, production-grade data solutions, not experimental projects that never ship. Engineers here take ownership of building scalable pipelines that directly impact business outcomes for large organizations. You'll collaborate with cross-functional teams, gain exposure to diverse industries, and help shape a growing data and AI practice. It's an ideal role for someone who wants both technical depth and client-facing impact in a fast-evolving environment.
Required Skills & Experience
- 3+ years of experience in data engineering
- Hands-on experience with Databricks and Delta Lake
- Strong experience with Apache Spark (PySpark preferred)
- Advanced SQL skills for large-scale data transformation
- Experience with cloud platforms (AWS or Azure)
- Experience building and maintaining production data pipelines
- Understanding of data modeling and lakehouse architectures
Desired Skills & Experience
- Experience with Delta Live Tables or similar frameworks
- Familiarity with dbt or data transformation tooling
- Exposure to data governance tools (Collibra, Purview, etc.)
- Experience with Kafka or streaming pipelines
- Background in consulting or multi-client environments
What You Will Be Doing
Tech Breakdown
- 70% Databricks / Spark / Data Engineering
- 30% Cloud + Data Modeling + Collaboration
Daily Responsibilities
- 80% Hands On
- 15% Team Collaboration
- 5% Management Duties
The Offer
- Competitive Hourly Rate
You will receive the following benefits:
- Medical, Dental, and Vision Insurance
Applicants must be currently authorized to work in the US on a full-time basis now and in the future.
#LI-CD1