Job Description Role Overview:
We are looking for a Senior Data Engineer to design, build, and scale robust data pipelines and data products. The role focuses on driving efficient data ingestion, implementing Delta Live Tables (DLT) pipelines, and applying medallion architecture (Bronze/Silver/Gold) to ensure high-quality, reliable, and scalable data solutions.
Key Responsibilities:
- Design and develop scalable data ingestion frameworks for batch and streaming data
- Build and maintain Delta Live Tables (DLT) pipelines for reliable data processing
- Implement and optimize medallion architecture (Bronze, Silver, Gold layers)
- Develop high-quality, reusable, and production-grade data products
- Ensure data quality, governance, and performance optimization across pipelines
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Monitor, troubleshoot, and enhance existing data workflows
Required Skills & Experience:
- Strong experience in data engineering (8+ years preferred)
- Hands-on experience with Delta Live Tables (DLT) and platforms like Databricks
- Solid understanding of medallion architecture and data modelling concepts
- Proficiency in Python and/or SQL
- Experience with ETL/ELT pipeline development and optimization
- Familiarity with Government cloud platforms such as AWS or (Azure/Google Cloud Platform)
- Strong problem-solving and performance tuning skills
Preferred Qualifications:
- Experience with real-time/streaming data pipelines
- Knowledge of data governance, lineage, and cataloguing tools
- Exposure to CI/CD for data pipelines
- Experience working in large-scale enterprise environments
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior