Senior Data Engineer
Posted 1 week ago by Queen Square Recruitment
£550 Per day
Inside
Hybrid
Glasgow, Scotland, United Kingdom
Summary: The Senior Data Engineer role involves joining a global consultancy's Enterprise Systems Management (ESM) team on a 6-month contract basis. The position requires designing, developing, and maintaining applications that support innovative technology solutions in a global banking environment. The engineer will collaborate with agile squads and contribute to scalable ETL processes while ensuring data consistency and reliability. This role demands strong expertise in Python and Databricks, along with significant experience in data engineering.
Key Responsibilities:
- Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management.
- Build and support self-service portals, incident/change management, and capacity management tools.
- Develop event management solutions, including monitoring, log-collection, correlation, and analytics dashboards.
- Implement application performance monitoring across large-scale distributed systems.
- Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks.
- Develop and deploy ETL jobs, extracting and transforming data from multiple sources.
- Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading.
- Create and manage data pipelines with robust error handling and data consistency.
Key Skills:
- 6–8 years’ experience in data engineering or related roles.
- Strong expertise in Python and Databricks.
- Experience with developing and maintaining ESM applications.
- Proven experience managing end-to-end data engineering lifecycles.
- Strong background in data pipelines, error handling, and ensuring accuracy and consistency.
Salary (Rate): £550 daily
City: Glasgow
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: Senior
Industry: IT
Senior Data Engineer – ESM
Contract: 6 months
Rate: £500 – £550 per day (inside IR35)
Location: Glasgow (3 days onsite per week)
Start date: ASAP
Our client, a large global consultancy, is seeking a Senior Data Engineer to join a Enterprise Systems Management (ESM) team on a contract basis. ESM plays a critical role in developing and maintaining applications across the business, enabling the delivery of innovative technology solutions for a global banking environment. You will join a diverse and collaborative chapter of 70+ developers, working closely with over 15 agile squads and contributing to technology solutions that support more than 10,000 developers and production engineers worldwide.
Key Responsibilities:
- Design, develop, and maintain ESM applications across data management, automation, orchestration, and service management.
- Build and support self-service portals, incident/change management, and capacity management tools.
- Develop event management solutions, including monitoring, log-collection, correlation, and analytics dashboards.
- Implement application performance monitoring across large-scale distributed systems.
- Collaborate with cross-functional teams to design scalable and reliable ETL processes using Python and Databricks.
- Develop and deploy ETL jobs, extracting and transforming data from multiple sources.
- Take ownership of the full engineering lifecycle: data extraction, cleansing, transformation, and loading.
- Create and manage data pipelines with robust error handling and data consistency.
Your Profile:
Essential Skills & Experience
- 6–8 years’ experience in data engineering or related roles.
- Strong expertise in Python and Databricks.
- Experience with developing and maintaining ESM applications.
Desirable Skills
- Proven experience managing end-to-end data engineering lifecycles.
- Strong background in data pipelines, error handling, and ensuring accuracy and consistency.
If you have the required skills and experience, please submit your application promptly, ensuring the required skills are on your CV. Please note that due to the volume of applications we receive, it is not possible to provide feedback on all applications.