Data Engineer - Big Data
Posted 1 week ago by BrightBox Group
£550 Per day
Inside
Hybrid
Gloucester
Summary: The Data Engineer role involves designing and implementing data pipelines within the AWS ecosystem, requiring a strong background in data architecture and engineering. The position is hybrid, with 2-3 days per week in Gloucester, and requires active security clearance. The successful candidate will collaborate with data scientists and analysts to ensure data availability and optimize data models for business intelligence. This role also emphasizes best practices in data management, security, and compliance.
Key Responsibilities:
- Develop, construct, test, and maintain data architectures and data processing systems.
- Collaborate with data scientists and analysts to understand data requirements and ensure data availability.
- Design and optimise data models to support business intelligence and reporting needs.
- Monitor and troubleshoot data systems to ensure high availability and performance.
- Implement best practises for data management, security, and compliance.
Key Skills:
- Active Security Clearance
- Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR.
- Strong experience with big data technologies and frameworks.
- Solid understanding of data modelling, ETL processes, and database management.
- Ability to work effectively in a team environment and communicate technical concepts clearly to non-technical stakeholders.
Salary (Rate): £550/day
City: Gloucester
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
Data Engineer
Hybrid working (2-3 days per week in Gloucester)
£450-£550 per day (inside IR35)
We are seeking a skilled, Security Cleared, Data Engineer to join our team. The ideal candidate will have a strong background in data architecture and engineering, specifically within the AWS ecosystem. You will be responsible for designing and implementing data pipelines that support large-scale data processing and analytics.
Key Responsibilities:
- Develop, construct, test, and maintain data architectures and data processing systems.
- Collaborate with data scientists and analysts to understand data requirements and ensure data availability.
- Design and optimise data models to support business intelligence and reporting needs.
- Monitor and troubleshoot data systems to ensure high availability and performance.
- Implement best practises for data management, security, and compliance.
Required Skills:
- Active Security Clearance
- Proficiency in AWS services related to data processing and storage, such as Amazon S3, Redshift, and EMR.
- Strong experience with big data technologies and frameworks.
- Solid understanding of data modelling, ETL processes, and database management.
- Ability to work effectively in a team environment and communicate technical concepts clearly to non-technical stakeholders.