Data Engineer
Posted 1 day ago by Maxwell Bond
£53 Per hour
Outside
Onsite
Manchester Area, United Kingdom
Summary: The Data Engineer role involves enhancing a live Google Cloud data platform through ingestion, transformation, and reporting processes. The position requires collaboration with data colleagues to establish standards and ensure data quality. The contract is initially for three months with a strong possibility of extension, requiring on-site presence two days a week in Manchester. The role is classified as outside IR35.
Key Responsibilities:
- Review the central data platform architecture, pipelines, and code standards
- Improve scalability, performance, monitoring, and disaster recovery
- Audit all data sources across the business
- Build secure ingestion pipelines for new sources
- Design and build reporting tables for business dashboards
- Support Looker dashboard development
- Define and implement a single customer view
- Build automated matching, deduplication, and cleansing pipelines
- Embed automated data quality checks across all pipelines
- Implement monitoring and alerting for data failures and anomalies
- Apply GDPR, encryption, access control, and data masking standards
- Run regular status check-ins with internal data colleagues
- Own data definitions, glossary, and metric governance
- Transform data using Python as the core language
- Load processed data into GCP test and production environments
- Provide access to data via Tableau, Google Sheets, and Python scripts
- Produce full documentation and an entity diagram
Key Skills:
- Strong hands-on Data Engineering experience
- Advanced Python for data transformation
- Google Cloud Platform production experience
- Data pipeline design and optimisation
- Data quality automation and monitoring
- Customer data and identity matching
- GDPR and data governance delivery
- Stakeholder communication in agile teams
- Looker or Tableau exposure
- BigQuery data modelling
- Experience building single customer views
Salary (Rate): £53.00/hr
City: Manchester
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Contract Data Engineer 3 month initial contract (with good chance of extension) Manchester, 2 days per week on-site Outside IR35 Start before Christmas
Overview
You will review and improve a live Google Cloud data platform. You will lead ingestion, transformation, quality, and reporting enablement. You will work with data colleagues on shared standards and delivery.
Key Responsibilities
- Review the central data platform architecture, pipelines, and code standards
- Improve scalability, performance, monitoring, and disaster recovery
- Audit all data sources across the business
- Build secure ingestion pipelines for new sources
- Design and build reporting tables for business dashboards
- Support Looker dashboard development
- Define and implement a single customer view
- Build automated matching, deduplication, and cleansing pipelines
- Embed automated data quality checks across all pipelines
- Implement monitoring and alerting for data failures and anomalies
- Apply GDPR, encryption, access control, and data masking standards
- Run regular status check-ins with internal data colleagues
- Own data definitions, glossary, and metric governance
- Transform data using Python as the core language
- Load processed data into GCP test and production environments
- Provide access to data via Tableau, Google Sheets, and Python scripts
- Produce full documentation and an entity diagram
Core Skills
- Strong hands-on Data Engineering experience
- Advanced Python for data transformation
- Google Cloud Platform production experience
- Data pipeline design and optimisation
- Data quality automation and monitoring
- Customer data and identity matching
- GDPR and data governance delivery
- Stakeholder communication in agile teams
- Looker or Tableau exposure
- BigQuery data modelling
- Experience building single customer views