Summary: The role of DevOps & Cloud Engineer involves deploying and managing cloud infrastructure for various products, ensuring integration with vendor systems, and establishing best practices for security and performance. The position requires collaboration with cross-functional teams to address technical issues and optimize data delivery processes. The engineer will also be responsible for monitoring, upgrading, and maintaining cloud environments to ensure high availability and scalability. This role is based in Knutsford and classified as inside IR35.

Key Responsibilities:

• Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
• Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
• Establish best practices for cloud security, scalability, and performance.
• Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
• Ensure high availability, scalability, and fault tolerance of Airflow clusters.
• Implement monitoring, alerting, and logging for Airflow and related components.
• Perform upgrades and patches for platform-related components.
• Oversee capacity planning, resource allocation, and optimization of Airflow workers.
• Maintain and configure integrations with source control systems (eg, GitHub, GitLab) for version control.
• Collaborate with cloud providers (eg, AWS) for pipeline integration and scaling requirements.
• Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
• Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
• Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.

Key Skills:

• Experience with cloud infrastructure deployment and management.
• Proficiency in AWS and SQL technologies.
• Knowledge of data integration and ETL processes.
• Familiarity with monitoring, alerting, and logging tools.
• Experience with version control systems (eg, GitHub, GitLab).
• Strong understanding of cloud security and performance best practices.
• Ability to collaborate with cross-functional teams.
• Problem-solving skills and process improvement capabilities.

Salary (Rate): 322

City: Knutsford

Country: UK

Working Arrangements: on-site

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT