Senior Data Engineer

Senior Data Engineer

Whitehall Resources are looking for a Senior Data Engineer. This role is hybrid working with 3 days per week on site in Hounslow, and the remainder remote working, for an initial 3 month contract.

***Inside IR35***

Job Description:
As a senior data engineer, you’ll play a critical role in building and optimizing modern, scalable data solutions that enable smarter decision-making, richer customer experiences and operational excellence. You’ll be a part of a highly collaborative network of teams working with cutting edge cloud-based technologies whilst also navigating complex legacy ‘on-premise’ environments .

Your responsibilities:
* Design, build and maintain robust data pipelines that support critical business applications and analytics
* Analyze, re-engineer and modernize existing ETL processes from legacy systems into scalable cloud-native solutions
* Contribute to the development and optimization of a cloud-based data platform, leveraging tools like snowflake, AWS and airflow
* Work closely with data architects, analysts and other engineers to deliver high-quality, production-ready code
* Participate in code reviews, ensuring adherence to best practices and high engineering standards
* Investigate data quality issues and implement monitoring and alterting systems to ensure pipeline reliability
* Document workflows, data lineage and technical designs to support maintainability and knowledge sharing
* Champion a culture of continuous improvement, experimentation and technical excellence within the team

Essential skills and experience:
* Strong hands-on experience with data engineering in both on-prem and cloud-based environments
* Good working knowledge and hands on experience working with Teradata and Infomatica.
* Proficiency in working with legacy systems and traditional ETL workflows
* Solid experience building data pipelines using modern tools (Airflow, DBT, Glue etc.) and working with large volumes of structures and semi-structured data
* Demonstrated experience with SQL and Python for data manipulation, pipeline development and workflow orchestration
* Strong grasp of data modelling, data warehousing concepts and performance optimization techniques
* Hands-on exposure to cloud platforms, especially AWS
* Experience working in agile teams and using version control and CI/CD practices

Desirable skills and experience:
* Experience with Snowflake or other cloud-native data warehouse technologies
* Familiarity with GraphQL and its use in data-driven APIs
* Exposure to data governance, data quality and metadata management tools
* Interest or experience in applying machine learning / AI pipelines or features within a data engineering context
* Understanding of DevOps conceps as applied to data (DataOps) and infrastructure-as-code tools like Teraform or Cloudformation
* Previous experience in highly regulated industries or large-scale, enterprise-grade environments

All of our opportunities require that applicants are eligible to work in the specified country/location, unless otherwise stated in the job description.

Whitehall Resources are an equal opportunities employer who value a diverse and inclusive working environment. All qualified applicants will receive consideration for employment without regard to race, religion, gender identity or expression, sexual orientation, national origin, pregnancy, disability, age, veteran status, or other characteristics.