Data Integration Developer
Posted 1 day ago by Hays Technology
£525 Per day
Outside
Remote
Birmingham, West Midlands
Summary: Hays Technology is seeking a Data Integration Developer for a remote role with a public sector client, expected to last until the end of March with potential for extension. The developer will be responsible for creating an integrated data platform that consolidates various data sources and implements API integrations for user provisioning. Key tasks include building ingestion pipelines, data transformation, and ensuring robust error handling. The position requires expertise in API development and data modeling for Power BI.
Key Responsibilities:
- Deliver an integrated data platform combining workforce, learning, and performance data from multiple systems.
- Implement Learning Pool User Provisioning via API for automated CRUD operations.
- Build integration to the Learning Pool External Extended API for LMS user management.
- Develop transformation logic to unify data from Unit4 and Learning Pool feeds.
- Implement Slowly Changing Dimensions (SCDs) handling and identity resolution.
- Design schemas optimized for Power BI and semantic modeling.
Key Skills:
- Experience with API development and integration.
- Proficiency in SQL and database management (SQL/MariaDB).
- Knowledge of data transformation and modeling techniques.
- Familiarity with Power BI and data visualization.
- Understanding of error handling and data quality assurance.
Salary (Rate): £525/day
City: Birmingham
Country: United Kingdom
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: Mid-Level
Industry: IT
Hays Technology are looking for a Data Integration Developer for our public sector client. The role will be remote and will run until the end of March with a view to extend. You will be responsible for:
Delivering an integrated data platform to combine workforce, learning, and (future) performance data from multiple systems:
- Unit4 (HR/Employee Data)
- Learning Pool (LMS Data)
- Nightly SQL/MariaDB Database Backups from Learning Pool
- Existing Data Lake assets
- Power BI consumption layer
In parallel, they are implementing Learning Pool User Provisioning via API, enabling automated CRUD operations for LMS accounts. A dedicated resource is required to deliver the ingestion pipelines, modelling, API integrations, and operational components.
API Development
- Build integration to the Learning Pool External Extended API for Create, Retrieve, Update, and Delete LMS users.
- Implement all mandatory and optional schema attributes, including:
- Organisation hierarchy
- Position hierarchy
- Manager/appraiser assignments
- Custom fields
- Preferences
- Implement robust error-handling for all LP error codes.
Data Transformation
- Build transformation logic to unify data from Unit4 and Learning Pool feeds.
- Implement Slowly Changing Dimensions (SCDs Type-1[Overwrite] and Type-2 [Track History] handling.
- Perform identity resolution using email as primary key (and fallback fuzzy matching if needed).
- Design schemas optimised for Power BI and semantic modelling
Hays Specialist Recruitment Limited acts as an employment agency for permanent recruitment and employment business for the supply of temporary workers. By applying for this job you accept the T&C's, Privacy Policy and Disclaimers which can be found at (url removed)