Senior Data Consultant
Posted Today by IO Associates
£550 Per day
Undetermined
Undetermined
UK; London; Birmingham; Manchester; Glasgow; Liverpool; Leeds; Edinburgh; Bristol; Cardiff; Nottingham
Summary: The role of Senior Data Consultant involves working with a global software consultancy to enhance digital products and legacy systems through robust data engineering practices. The position emphasizes quality and maintainability in data systems, primarily using Databricks as the platform. The consultant will collaborate with engineers and data scientists to modernize data systems and build AI-ready data foundations. This is a 6-month contract position requiring strong technical expertise in data engineering and software principles.
Key Responsibilities:
- Modernising and re-platforming legacy data systems
- Building AI-ready data foundations and feature pipelines
- Embedding governance, testing, and data quality into platforms from the ground up
- Designing testable, production-grade data pipelines
- Applying software engineering principles to data systems
- Ensuring observability, lineage, and data quality in data architectures
- Collaborating with engineers, data scientists, and client stakeholders
Key Skills:
- Strong data engineering experience with solid software engineering fundamentals
- Hands-on Databricks experience (Delta Lake, Unity Catalog, Workflows, pipelines)
- Experience with lakehouse / medallion architectures
- Strong SQL, Python, and Spark capability
- Familiarity with dbt, data quality tooling, and CI/CD practices
- Experience in cloud environments (AWS or Azure)
- AI / ML data experience, including building feature pipelines and ML-ready datasets
- Ability to support AI use cases through robust data foundations
Salary (Rate): £550 per day
City: London
Country: UK
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
My client is a global software consultancy helping organisations build modern digital products, evolve legacy systems, and adopt strong engineering practices to improve delivery at scale.
They are seeking a Contract Senior Data Engineer who treats data engineering as software engineering; focusing on quality, operability, and long-term maintainability.
Databricks is the primary platform, and fluency is expected, but the emphasis is on building robust data systems rather than tool-specific implementation.
6-month initial contract
What You'll Need
- Strong data engineering experience with solid software engineering fundamentals
- Hands-on Databricks experience (Delta Lake, Unity Catalog, Workflows, pipelines)
- Experience with lakehouse / medallion architectures
- Strong SQL + Python + Spark capability
- Familiarity with dbt, data quality tooling, and CI/CD practices
Core Strengths
- Building testable, production-grade data pipelines
- Applying software engineering principles to data systems
- Designing for observability, lineage, and data quality
- Working in cloud environments (AWS or Azure)
AI / ML Data Experience
- Building feature pipelines and ML-ready datasets
- Supporting MLflow-based tracking and lineage
- Experience with embedding / retrieval pipelines and vector data workflows
- Ability to support AI use cases through robust data foundations
Collaboration
You'll work closely with engineers, data scientists, and client stakeholders, operating within fast-moving delivery environments and balancing technical quality with pragmatic decision-making.
Typical Work
- Modernising and re-platforming legacy data systems
- Building AI-ready data foundations and feature pipelines
- Embedding governance, testing, and data quality into platforms from the ground up