AWS Integration Engineer

AWS Integration Engineer

Posted 4 days ago by Undisclosed

Apply
£414 Per day
Inside
Hybrid
Knutsford, England, United Kingdom
Apply
Airflow Amazon Web Services (AWS) Apache Airflow Automation Cloud Computing Cloud Infrastructure Cloud Technology Cross-Functional Integration Data Extraction Data Lakes Data Pipeline Github Gitlab Operational Efficiency Process Improvement Resource Allocation Scalability SQL (Programming Language) Stakeholder Management Version Control

Summary: The AWS Integration Engineer role involves deploying cloud infrastructure and facilitating integration between various vendor products and systems. The position requires managing deployments, ensuring high availability, and implementing best practices for cloud security and performance. The contract is set to run until December 20, 2025, with a strong possibility of extension. The role is hybrid, requiring some onsite work in Knutsford, London, or Glasgow.

Key Responsibilities:

  • Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
  • Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
  • Establish best practices for cloud security, scalability, and performance.
  • Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
  • Ensure high availability, scalability, and fault tolerance of Airflow clusters.
  • Implement monitoring, alerting, and logging for Airflow and related components.
  • Perform upgrades and patches for platform-related components.
  • Oversee capacity planning, resource allocation, and optimization of Airflow workers.
  • Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
  • Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
  • Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
  • Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.

Key Skills:

  • Experience with cloud infrastructure deployment, particularly in AWS.
  • Knowledge of Astronomer Airflow and AccelData environments.
  • Strong understanding of cloud security, scalability, and performance best practices.
  • Ability to manage and configure vendor product deployments.
  • Experience with monitoring, alerting, and logging for cloud components.
  • Proficiency in capacity planning and resource optimization.
  • Familiarity with source control systems like GitHub and GitLab.
  • Experience in process improvement and automation.
  • Strong skills in data extraction, transformation, and loading using AWS and SQL.
  • Ability to collaborate with cross-functional teams and stakeholders.
  • Experience in building analytical tools for business performance metrics.

Salary (Rate): £414 daily

City: Knutsford

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role Title: AWS Integration Engineer

Duration: contract to run until 20/12/2025 with high likelihood dof extension

Location: Knutsford. Hybrid, 2/3 day onsite (Some onsite work will be required –London and Glasgow may also be options).

Rate: up to £414 p/d Umbrella inside IR35

Key Skills/ requirements

  • Deploy comprehensive cloud infrastructure for various products, including Astronomer Airflow and AccelData environments.
  • Facilitate cross-functional integration between vendor products and other systems, such as data lakes, storage, and compute services.
  • Establish best practices for cloud security, scalability, and performance.
  • Manage and configure vendor product deployments, ensuring the setup and maintenance of environments.
  • Ensure high availability, scalability, and fault tolerance of Airflow clusters.
  • Implement monitoring, alerting, and logging for Airflow and related components.
  • Perform upgrades and patches for platform-related components.
  • Oversee capacity planning, resource allocation, and optimization of Airflow workers.
  • Maintain and configure integrations with source control systems (e.g., GitHub, GitLab) for version control.
  • Collaborate with cloud providers (e.g., AWS) for pipeline integration and scaling requirements.
  • Identify, design, and implement internal process improvements, including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
  • Develop infrastructure for optimal extraction, transformation, and loading of data from various sources using AWS and SQL technologies.
  • Work with stakeholders, including design, product, and executive teams, to address platform-related technical issues.
  • Build analytical tools to leverage the data pipeline, providing actionable insights into key business performance metrics, such as operational efficiency and customer acquisition.?

All profiles will be reviewed against the required skills and experience. Due to the high number of applications we will only be able to respond to successful applicants in the first instance. We thank you for your interest and the time taken to apply!

Apply
Similar Jobs
Loading data...