Negotiable
Outside
Onsite
London Area, United Kingdom
Summary: The Senior Data Analyst role focuses on designing, building, and operating real-time data processing solutions using Amazon Managed Service for Apache Flink (MSF) on AWS. The position requires extensive experience in data streaming and analytics, along with the ability to manage scalable data pipelines and CI/CD processes. The candidate will collaborate with cross-functional teams to ensure high-quality solutions and optimize performance. This is a contract position based in London, UK, classified as outside IR35.
Key Responsibilities:
- Design, develop, and manage real-time streaming applications using Amazon Managed Service for Apache Flink (MSF)
- Build scalable data pipelines for data analytics and real-time processing
- Integrate streaming solutions with Amazon MSK (Kafka), Amazon Redshift, and Amazon Aurora
- Implement and maintain CI/CD pipelines for data and streaming workloads
- Develop and manage infrastructure using AWS CloudFormation
- Monitor, optimize, and troubleshoot streaming and analytics systems for performance and reliability
- Collaborate with cross-functional teams to deliver high-quality, production-ready solutions
- Use Kiro ID for secure identity and access management across systems
Key Skills:
- Strong hands-on experience with Amazon Managed Service for Apache Flink (MSF)
- Solid data analytics expertise (batch and streaming)
- Experience with Amazon MSK (Kafka)
- Proficiency in Amazon Redshift and Amazon Aurora
- Strong CI/CD implementation experience
- Hands-on experience with AWS CloudFormation
- Exposure to Machine Learning concepts or ML-driven data pipelines (good to have)
- Strong understanding of cloud-native architectures on AWS (preferred)
- Experience with high-throughput, low-latency streaming systems (preferred)
- Excellent problem-solving and collaboration skills
Salary (Rate): undetermined
City: London
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Job Title - Senior Data Analyst
Current Location - London, UK
Work Mode - Onsite
Job Type - Contract
Outside IR 35
Experience - 7+ Years
Job Description - We are seeking an experienced Data Streaming & Analytics Engineer with strong expertise in Amazon Managed Service for Apache Flink (MSF) to design, build, and operate real-time data processing solutions on AWS. The role involves working with large-scale streaming data, analytics platforms, CI/CD pipelines, and cloud-native infrastructure.
Key Responsibilities
- Design, develop, and manage real-time streaming applications using Amazon Managed Service for Apache Flink (MSF)
- Build scalable data pipelines for data analytics and real-time processing
- Integrate streaming solutions with Amazon MSK (Kafka), Amazon Redshift, and Amazon Aurora
- Implement and maintain CI/CD pipelines for data and streaming workloads
- Develop and manage infrastructure using AWS CloudFormation
- Monitor, optimize, and troubleshoot streaming and analytics systems for performance and reliability
- Collaborate with cross-functional teams to deliver high-quality, production-ready solutions
- Use Kiro ID for secure identity and access management across systems
Required Skills
- Strong hands-on experience with Amazon Managed Service for Apache Flink (MSF)
- Solid data analytics expertise (batch and streaming)
- Experience with Amazon MSK (Kafka)
- Proficiency in Amazon Redshift and Amazon Aurora
- Strong CI/CD implementation experience
- Hands-on experience with AWS CloudFormation
Good to Have
- Exposure to Machine Learning concepts or ML-driven data pipelines
- Experience working with large-scale, real-time data systems
Preferred Qualifications
- Strong understanding of cloud-native architectures on AWS
- Experience with high-throughput, low-latency streaming systems
- Excellent problem-solving and collaboration skills