Data Engineer - SC Cleared

Data Engineer - SC Cleared

Posted Today by Whitehall Resources

Apply
Negotiable
Inside
Hybrid
Telford, England, United Kingdom
Apply
Data Warehousing Informatica Metadata Microsoft Word Notepad++ Scheduling Scripting Security Clearance SQL (Programming Language) Stakeholder Management Unix Unix Shell WinSCP

Summary: The Data Engineer role requires an SC Cleared professional to support the migration from legacy data warehouses to a new Data Lakehouse architecture. The position involves detailed analysis using Informatica Advanced Scanning techniques and collaboration with various teams to ensure accurate documentation and alignment with migration objectives. The role is hands-on and requires strong attention to detail and stakeholder collaboration. Active SC Clearance is essential for this position.

Key Responsibilities:

  • Perform detailed analysis of legacy data warehouses using Informatica Advanced Scanning techniques.
  • Produce a complete and accurate as is representation of each data warehouse.
  • Identify and document all inbound data feeds consumed by CDW, including source/origin systems, data formats, and full feed by feed data content.
  • Capture and document the actual metadata held within the data warehouse, including table structures and field names and definitions.
  • Identify and document all outbound data feeds from the data warehouse, including consuming systems or platforms, full feed by feed data content, and outbound metadata.
  • Generate bespoke outputs from Informatica Advanced Scanning for each legacy warehouse to support analysis and migration planning.
  • Collaborate with architecture, data, and migration teams to ensure outputs are aligned to Data Lakehouse migration objectives.
  • Ensure documentation is clear, accurate, and suitable for use in downstream migration and governance activities.

Key Skills:

  • Strong experience with Unix shell scripting.
  • PL/SQL and Oracle SQL.
  • Maestro / TWS scheduling tools.
  • ETL concepts and implementations.
  • Command line tools (PuTTY / CLI).
  • File transfer tools (e.g. WinSCP).
  • Use of text and documentation tools (e.g. Notepad++, Word or equivalent).

Salary (Rate): undetermined

City: Telford

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer - SC Cleared

Whitehall Resources currently require an SC Cleared Data Engineer to work with a key client

Please note this role requires 2 days onsite weekly in Telford and falls INSIDE IR35

Active SC Clearance Essential

Role Overview:

An experienced Data Engineer is required to support the team in delivering Informatica Advanced Scans across legacy data warehouses. This role is a key enabler for the strategic migration from legacy data warehouses to the new Data Lakehouse architecture. The successful candidate will work closely with stakeholders to establish a comprehensive and accurate as is view of each legacy warehouse, leveraging Informatica Advanced Scanning capabilities wherever possible.

Key Responsibilities:

  • Perform detailed analysis of legacy data warehouses using Informatica Advanced Scanning techniques.
  • Produce a complete and accurate as is representation of each data warehouse.
  • Identify and document all inbound data feeds consumed by CDW, including:
    • Source/origin systems
    • Data formats
    • Full feed by feed data content
  • Capture and document the actual metadata held within the data warehouse, including:
    • Table structures
    • Field names and definitions
  • Identify and document all outbound data feeds from the data warehouse, including:
    • Consuming systems or platforms
    • Full feed by feed data content
    • Outbound metadata (tables, fields, and structures)
  • Where possible, generate bespoke outputs from Informatica Advanced Scanning for each legacy warehouse to support analysis and migration planning.
  • Collaborate with architecture, data, and migration teams to ensure outputs are aligned to Data Lakehouse migration objectives.
  • Ensure documentation is clear, accurate, and suitable for use in downstream migration and governance activities.

Required Skills and Experience:

  • Strong experience with Unix shell scripting
  • PL/SQL and Oracle SQL
  • Maestro / TWS scheduling tools
  • ETL concepts and implementations
  • Command line tools (PuTTY / CLI)
  • File transfer tools (e.g. WinSCP)
  • Use of text and documentation tools (e.g. Notepad++, Word or equivalent)

Desirable Knowledge and Experience:

  • SA Profiles extracts
  • SA MARTs
  • SA Warehouse structures and concepts
  • Caseflow and KBS
  • Authorete
  • Eureka Business Objects tooling:
    • BO Infoview
    • BO Developer
    • BO CMC
    • BO Import Wizard

Additional Information:

  • This role is hands on and delivery focused, supporting a critical phase of legacy to Lakehouse migration.
  • Strong attention to detail, documentation quality, and stakeholder collaboration are essential
Apply
Similar Jobs
Loading data...