Summary: The Data Migration Engineer role focuses on executing large-scale data migration projects utilizing Google Cloud Platform and Snowflake. The position requires strong technical skills in data engineering, ETL development, and proficiency in SQL and Python. The engineer will work within Agile teams to ensure data quality and validation throughout the migration process. This role is based in London and classified as inside IR35.
Key Responsibilities:
- Deliver large-scale data migration projects.
- Utilize Google Cloud Platform services such as BigQuery, Cloud Storage, and Cloud SQL.
- Work with Snowflake as a target data platform.
- Develop advanced SQL queries and Python scripts for data processing and automation.
- Implement ETL/ELT processes using tools like dbt, Matillion, Informatica, or similar.
- Establish data validation, reconciliation, and quality assurance processes.
- Understand relational databases and data warehouse concepts.
- Perform source-to-target mapping and data transformation.
- Utilize version control with Git.
- Collaborate within Agile delivery teams.
Key Skills:
- 4+ years of experience in data migration, data engineering, or ETL development.
- Proven experience with Google Cloud Platform (BigQuery, Cloud Storage, Cloud SQL).
- Experience with Snowflake as a target data platform.
- Advanced SQL development skills.
- Strong Python skills for data processing and automation.
- Experience with ETL/ELT tools such as dbt, Matillion, Informatica, Talend, or Fivetran.
- Experience developing data validation, reconciliation, and quality assurance processes.
- Understanding of relational databases and data warehouse concepts.
- Familiarity with version control using Git.
- Experience working within Agile delivery teams.
Salary (Rate): £350/Day
City: London
Country: UK
Working Arrangements: undetermined
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Required Skills & Experience
- 4+ years of experience in data migration, data engineering, or ETL development.
- Proven experience delivering large-scale data migration projects.
- Strong experience with Google Cloud Platform, including:
- BigQuery
- Cloud Storage (GCS)
- Cloud SQL
- Experience working with Snowflake as a target data platform.
- Advanced SQL development skills.
- Strong Python skills for data processing and automation.
- Experience with ETL/ELT tools such as dbt, Matillion, Informatica, Talend, Fivetran, or similar.
- Experience developing data validation, reconciliation, and quality assurance processes.
- Understanding of relational databases and data warehouse concepts.
- Experience with source-to-target mapping and data transformation.
- Familiarity with version control using Git.
- Experience working within Agile delivery teams.
Technical Skills
- Snowflake
- Google Cloud Platform (BigQuery, Cloud Storage, Cloud SQL)
- SQL
- Python
- dbt
- ETL/ELT
- Data Migration
- Data Validation
- Data Reconciliation
- Apache Airflow
- Git
- REST APIs
- Data Profiling
- Data Quality