Data Engineer/Architect Oil and Gas (Outside IR35)

Data Engineer/Architect Oil and Gas (Outside IR35)

Posted 1 day ago by Telosta

Negotiable
Outside
Hybrid
London Area, United Kingdom

Summary: A Data Engineer is needed to design, manage, and optimize a Data Warehouse for an organization in the upstream oil and gas sector. The role involves leading data integration from key industry systems, ensuring data accuracy for decision-making, and supporting analytics across various teams. The successful candidate will deliver a high-performing data environment tailored to the complexities of upstream operations. This position is hybrid and based in London or Aberdeen, classified as outside IR35.

Key Responsibilities:

  • Own and maintain the organisation’s Data Warehouse as a single source of truth.
  • Monitor and optimise warehouse performance, scalability, and resilience.
  • Develop and implement robust data quality controls, including cleansing and validation processes.
  • Define and enforce governance standards for data consistency, security, and regulatory compliance.
  • Maintain detailed audit trails and documentation for all data transformations.
  • Identify opportunities for automation and process improvement across the data lifecycle.
  • Manage data pipelines from upstream oil and gas systems, including SAP, Energy Components, and PI Process Book.
  • Ensure seamless ingestion, transformation, and storage of data in support of field operations, production reporting, and commercial analysis.
  • Troubleshoot data flow issues and work with IT and business teams to onboard new data sources as needed.
  • Collaborate with engineers, commercial analysts, and other stakeholders to deliver actionable reporting and insights.
  • Support dashboard development and reporting structures using tools like Power BI, ensuring alignment with upstream KPIs and operational workflows.
  • Act as a key technical resource for business intelligence tools and reporting optimisation.

Key Skills:

  • Proven experience as a Data Engineer or ETL Developer, ideally within the upstream oil and gas industry.
  • Advanced SQL skills and expertise in relational database and data warehouse management.
  • Hands-on experience with SAP, Energy Components, PI ProcessBook, or similar upstream systems.
  • Strong knowledge of data quality assurance, cleansing, and validation techniques.
  • Proficiency with Power BI or comparable reporting/visualisation platforms.
  • Background in oil and gas data domains, including production, metering, hydrocarbon accounting, or commercial reporting.
  • Experience with Python, R, or similar scripting languages for data manipulation and automation.
  • Familiarity with data governance standards and compliance frameworks (e.g., GDPR, ISO 27001).
  • Strong troubleshooting skills with experience resolving upstream data flow issues.
  • Expertise in ETL/ELT development and data integration specific to oil and gas environments.
  • High attention to detail, especially around data integrity and auditability.
  • Collaborative approach with technical and business stakeholders.
  • Proactive, adaptable, and capable of operating in a fast-paced, asset-focused environment.

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Data Engineer – Oil & Gas (Upstream) Outside IR35 Based Hybrid - London or Aberdeen

Overview

A Data Engineer is sought to support the design, management, and optimisation of a Data Warehouse environment for an organisation operating in the upstream oil and gas sector. The successful candidate will lead data integration from key industry systems such as SAP, Energy Components, and PI Process Book, ensuring the accuracy and availability of data for operational and commercial decision-making. Success in this role means delivering a high-performing, validated data environment tailored to the complexities of upstream operations. The role supports business-critical analytics and reporting across technical, commercial, and operational teams.

Key Responsibilities

  • Data Warehouse Management
  • Own and maintain the organisation’s Data Warehouse as a single source of truth.
  • Monitor and optimise warehouse performance, scalability, and resilience.
  • Develop and implement robust data quality controls, including cleansing and validation processes.
  • Data Quality & Governance
  • Define and enforce governance standards for data consistency, security, and regulatory compliance.
  • Maintain detailed audit trails and documentation for all data transformations.
  • Identify opportunities for automation and process improvement across the data lifecycle.
  • Data Integration & Pipeline Management
  • Manage data pipelines from upstream oil and gas systems, including SAP, Energy Components, and PI Process Book.
  • Ensure seamless ingestion, transformation, and storage of data in support of field operations, production reporting, and commercial analysis.
  • Troubleshoot data flow issues and work with IT and business teams to onboard new data sources as needed.
  • Reporting & Business Intelligence
  • Collaborate with engineers, commercial analysts, and other stakeholders to deliver actionable reporting and insights.
  • Support dashboard development and reporting structures using tools like Power BI, ensuring alignment with upstream KPIs and operational workflows.
  • Act as a key technical resource for business intelligence tools and reporting optimisation.

Required Experience & Qualifications

  • Proven experience as a Data Engineer or ETL Developer, ideally within the upstream oil and gas industry.
  • Advanced SQL skills and expertise in relational database and data warehouse management.
  • Hands-on experience with SAP, Energy Components, PI ProcessBook, or similar upstream systems.
  • Strong knowledge of data quality assurance, cleansing, and validation techniques.
  • Proficiency with Power BI or comparable reporting/visualisation platforms.

Preferred Qualifications

  • Background in oil and gas data domains, including production, metering, hydrocarbon accounting, or commercial reporting.
  • Experience with Python, R, or similar scripting languages for data manipulation and automation.
  • Familiarity with data governance standards and compliance frameworks (e.g., GDPR, ISO 27001).

Key Skills & Attributes

  • Strong troubleshooting skills with experience resolving upstream data flow issues.
  • Expertise in ETL/ELT development and data integration specific to oil and gas environments.
  • High attention to detail, especially around data integrity and auditability.
  • Collaborative approach with technical and business stakeholders.
  • Proactive, adaptable, and capable of operating in a fast-paced, asset-focused environment.