Technical Solution Engineer
Summary: The Technical Solution Engineer role requires demonstrable experience in designing, deploying, and operating big data platforms at scale, with hands-on expertise in open-source data ecosystems and cloud platforms. The position emphasizes security architecture, including threat modeling and secure design practices, as well as delivering end-to-end solution designs. Candidates should possess strong skills in Apache Airflow, Apache Spark, and Azure Cloud Services.
Key Responsibilities:
- Design, deploy, and operate big data platforms at scale.
- Work with OSS data ecosystems such as Spark, Trino, Airflow, and Apache Superset.
- Utilize cloud platforms and traditional on-premise hosting, with hands-on experience in Azure, AWS, or GCP.
- Implement security architecture practices including threat modeling and secure design.
- Manage IAM, RBAC/ABAC, and service-to-service authentication.
- Oversee encryption, key management, and secure logging practices.
- Deliver end-to-end solution designs from requirements to production operations and support.
Key Skills:
- Apache Airflow
- Apache Spark
- Azure Cloud Services
- Experience with OSS data ecosystems
- Security architecture expertise
- Threat modeling and secure design practices
- IAM, RBAC/ABAC concepts
- Encryption and key management
- Secure logging and telemetry
- Secure SDLC and vulnerability management
Salary (Rate): undetermined
City: Sheffield
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job Description
Demonstrable experience designing deploying and operating big data platforms at scale
Handson experience with OSS data ecosystems eg Spark Trino Airflow Apache Superset and similar technologies
Cloud platforms and traditional on premise hosting hands on experience with Azure AWS and or GCP is beneficial
Proven security architecture expertise is beneficial including
- Threat modelling and secure by design practices
- IAM RBACABAC privileged access concepts and service to service authentication
- Encryption in transit at rest key management secrets management
- Secure logging telemetry auditability and evidence driven control assurance
- Secure SDLC vulnerability management and dependency supply chain risk controls
Proven experience delivering end to end solution designs from requirements through to production operations and support
Skills Mandatory Skills : Apache Airflow, Apache Spark, Azure Cloud Services
Similar Jobs
Apologies, there are currently no similar jobs available.