Lead Data Engineer - Informatica - Data Warehouse Migration - AWS - Enterprise

Lead Data Engineer - Informatica - Data Warehouse Migration - AWS - Enterprise requirement for an urgent start.

The Lead Data Engineer - Informatica - Data Warehouse Migration - AWS - Enterprise will be working for an award winning government client.

Lead Data Engineer - Informatica - Data Warehouse Migration - AWS - Enterprise Key Skills

• Experience at principal/lead level in data engineering within a large-scale, data-driven organisation with mission-critical reporting obligations.
• Deep hands-on expertise with Informatica - PowerCenter (mappings, workflows, sessions, PowerExchange) and/or IDMC/IICS (CDI, CAI) - including performance tuning, migration and rationalisation of a large Legacy codebase.
• Proven delivery of a warehouse or ETL modernisation at scale, including reverse-engineering undocumented logic and proving output equivalence.
• Expert SQL and PL/SQL; strong Python; solid grasp of distributed processing (Spark).
• Expert knowledge of at least one hyperscaler's data stack - AWS strongly preferred (S3, Glue, Redshift, Athena, EMR, Step Functions, Lambda, IAM, KMS)
• Modern engineering practice applied to data: version control, CI/CD, infrastructure as code, automated testing, observability, peer review.
• Data modelling depth: dimensional, Data Vault, and normalised operational models.

Technical environment

Legacy Informatica PowerCenter, PowerExchange, IDQ; Oracle Exadata and Oracle EDW; PL/SQL; Control-M or equivalent scheduling; Mainframe and operational benefit system sources (Cobol/VSAM/DB2)

AWS (S3, Glue, Glue Data Catalog, Lake Formation, Redshift, Athena, EMR, Step Functions, Lambda, IAM, KMS); Python and PySpark; dbt; open table formats (Parquet, Iceberg/Delta); Airflow or Step Functions orchestration; Terraform; GitHub/GitLab CI; Power BI serving layer

Desirable

• Informatica IDMC/IICS, EDC, Axon, MDM Databricks Kafka/event streaming and CDC tooling Azure (Synapse, ADF, Fabric) or GCP (BigQuery)
• Data quality frameworks Collibra or equivalent