Data Engineer

Data Engineer

Posted 1 day ago by 1758006344

Negotiable
Undetermined
Undetermined
Birmingham

Summary: The Data Engineer will design and develop ETL pipeline processes to automate data access and quality checks, assist in creating data analysis and reporting systems, and develop dimensional data models. The role involves analyzing datasets for insights, maintaining the data platform, and ensuring compliance with data licensing and GDPR. The position requires extensive experience with Azure Synapse Analytics and programming skills in various languages.

Key Responsibilities:

  • Design and develop Extract, Transform and Load (ETL) pipeline processes to automate access to source data, quality check and increase usage.
  • Assist with the development of new data analysis and reporting systems.
  • Develop Dimensional Data Models using various frameworks.
  • Analyze various datasets, seeking to correlate and integrate these with other secondary and primary data sources in order to generate insight.
  • Identify and obtain key data sets that will add enhanced insight.
  • Assist in the development and maintenance of the data platform, tools and data library.
  • Model, map and document data and processes from source through to utilization within business processes.
  • Assist with the operation and maintenance of data portals to enable data access for users whilst supporting data licensing and GDPR compliance.
  • Respond efficiently to requests for intelligence from colleagues, partners and stakeholders as appropriate.

Key Skills:

  • Extensive working experience using Azure Synapse Analytics and Azure Data Factory.
  • Programming and scripting experience (e.g. FME, Python, DAX, JavaScript etc) to extract, transform and manage data.
  • Extensive experience using the Microsoft business intelligence stack e.g. Power Platform, SQL Server, SSAS, SSRS etc.

Salary (Rate): undetermined

City: Birmingham

Country: undetermined

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

As a Data Engineer, you will be responsible for the following:

  • Design and develop Extract, Transform and Load (ETL) pipeline processes to automate access to source data, quality check and increase usage.
  • Assist with the development of new data analysis and reporting systems.
  • Develop Dimensional Data Models using various frameworks.
  • To analyse various datasets, seeking to correlate and integrate these with other secondary and primary data sources in order to generate insight.
  • To identify and obtain key data sets that will add enhanced insight
  • Assist in the development and maintenance of the data platform, tools and data library
  • Model, map and document data and processes from source through to utilisation within business processes.
  • Assist with the operation and maintenance of data portals to enable data access for users whilst supporting data licencing and GDPR compliance.
  • Respond efficiently to requests for intelligence from colleagues, partners and stakeholders as appropriate.

You will need experience of:

  • Extensive working experience using Azure Synapse Analytics and Azure Data Factory
  • Programming and scripting experience (e.g. FME, Python, DAX, JavaScript etc) to extract, transform and manage data.
  • Extensive experience using the Microsoft business intelligence stack e.g. Power Platform, SQL Server, SSAS, SSRS etc