Job Description Role Overview
We are looking for a Senior Data Engineer to design, build, and scale robust data pipelines and data products.
Responsibilities
- Design and develop scalable data ingestion frameworks for batch and streaming data
- Build and maintain Delta Live Tables (DLT) pipelines for reliable data processing
- Implement and optimize medallion architecture (Bronze, Silver, Gold layers)
- Develop high-quality, reusable, and production-grade data products
- Ensure data quality, governance, and performance optimization across pipelines
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Monitor, troubleshoot, and enhance existing data workflows
Required Skills & Experience
- Strong experience in data engineering (8+ years preferred)
- Hands-on experience with Delta Live Tables (DLT) and platforms like Databricks
- Solid understanding of medallion architecture and data modelling concepts
- Proficiency in Python and/or SQL
- Experience with ETL/ELT pipeline development and optimization
- Familiarity with Government cloud platforms such as AWS or (Azure/Google Cloud Platform)
- Strong problem-solving and performance tuning skills
Preferred Qualifications
- Experience with real-time/streaming data pipelines
- Knowledge of data governance, lineage, and cataloguing tools
- Exposure to CI/CD for data pipelines
- Experience working in large-scale enterprise environments
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior