Data Engineer
Posted Today by Haystack
£525 Per day
Undetermined
Remote
United Kingdom
Summary: The Data Integration Developer role involves creating an integrated data platform for a public sector client, focusing on API development, data transformation, and SQL. The position requires expertise in unifying workforce and learning data from various systems. The role offers remote working flexibility and an initial contract with potential for extension. Candidates will leverage their skills to address significant data integration challenges.
Key Responsibilities:
- Deliver an integrated data platform combining workforce, learning, and performance data from diverse systems.
- Develop robust API integrations for automated CRUD operations of LMS accounts.
- Implement sophisticated data transformation logic to unify data from various feeds.
- Design schemas optimized for Power BI and semantic modeling.
- Resolve identity across disparate systems using email as a primary key.
Key Skills:
- Proven expertise in Data Integration and building ingestion pipelines.
- In-depth experience with API development and complex schema attributes.
- Strong proficiency in SQL and database technologies such as SQL/MariaDB.
- Ability to implement advanced data transformation techniques, including SCDs Type-1 and Type-2.
- Experience with Power BI and designing data models for business intelligence.
Salary (Rate): £525 daily
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Data Integration Developer | United Kingdom | Remote | £500 - £525
We're working with Hays Technology on this exciting opportunity. Are you a seasoned Data Integration Developer ready to make a significant impact? Join our public sector client through Hays Technology and build a cutting-edge integrated data platform. This is your chance to shine, leveraging your expertise in API development, data transformation, and SQL to unify critical workforce and learning data.
The Role
- Deliver an integrated data platform combining workforce, learning, and performance data from diverse systems like Unit4, Learning Pool, and existing Data Lake assets.
- Develop robust API integrations with Learning Pool's Extended API for automated CRUD operations of LMS accounts, including organization and position hierarchies.
- Implement sophisticated data transformation logic to unify data from Unit4 and Learning Pool feeds, utilizing Slowly Changing Dimensions (SCDs Type-1 and Type-2).
- Design schemas optimized for Power BI and semantic modeling, ensuring efficient data consumption and insightful reporting.
- Resolve identity across disparate systems using email as a primary key, with fallback fuzzy matching for comprehensive data integrity.
What You'll Need
- Proven expertise in Data Integration, with a strong focus on building ingestion pipelines and operational components.
- In-depth experience with API development, particularly integrating with external APIs and handling complex schema attributes and error management.
- Strong proficiency in SQL and database technologies such as SQL/MariaDB, coupled with solid understanding of data warehousing concepts.
- Demonstrated ability to implement advanced data transformation techniques, including Slowly Changing Dimensions (SCDs Type-1 and Type-2).
- Experience with Power BI consumption layer and designing data models optimized for business intelligence.
What's On Offer
- Competitive daily rate of £500 - £525.
- Remote working flexibility, allowing you to excel from anywhere.
- An initial contract until the end of March with strong potential for extension.
- Opportunity to work on a high-impact public sector project with significant data integration challenges.
- Apply via Haystack today!