AWS Integration Engineer

Summary: The AWS Integration Engineer role involves deploying cloud infrastructure for various products and facilitating integration between vendor products and systems. The position requires establishing best practices for cloud security and performance while managing vendor product deployments. The contract is set to run until December 20, 2025, with a high likelihood of extension, and includes a hybrid working arrangement. The role is classified as inside IR35 and offers a competitive daily rate.

Key Responsibilities:

• Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
• Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
• Establish best practices for cloud security, scalability, and performance.
• Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
• Ensure high availability, scalability, and fault tolerance of Airflow clusters.
• Implement monitoring, alerting, and logging for Airflow and related components.
• Perform upgrades and patches for platform-related components.
• Oversee capacity planning, resource allocation, and optimization of Airflow workers.
• Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
• Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
• Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
• Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
• Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.

Key Skills:

• Experience with AWS cloud services and infrastructure deployment.
• Proficiency in data integration and management tools.
• Strong understanding of cloud security and best practices.
• Experience with Airflow and related components.
• Knowledge of SQL technologies for data processing.
• Ability to collaborate with cross-functional teams.
• Strong problem-solving and analytical skills.
• Experience with source control systems like GitHub or GitLab.
• Capacity planning and resource optimization skills.
• Experience in building analytical tools and dashboards.

Salary (Rate): £414 daily

City: Knutsford

Country: England

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role Title: AWS Integration Engineer

Duration: contract to run until 20/12/2025 with high likelihood dof extension

Location: Knutsford. Hybrid, 2/3 day onsite (Some onsite work will be required -London and Glasgow may also be options).

Rate: up to £414 p/d Umbrella inside IR35

Key Skills/ requirements

• Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
• Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
• Establish best practices for cloud security, scalability, and performance.
• Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
• Ensure high availability, scalability, and fault tolerance of Airflow clusters.
• Implement monitoring, alerting, and logging for Airflow and related components.
• Perform upgrades and patches for platform-related components.
• Oversee capacity planning, resource allocation, and optimization of Airflow workers.
• Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
• Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
• Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
• Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
• Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.?

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!