Data Engineer (ML / AWS / Python)

Summary: The role of Data Engineer focuses on leveraging expertise in Machine Learning, AWS, and Python to build scalable data pipelines for a Southwest project. The candidate will work remotely and support advanced analytics through cloud-based data platforms. Responsibilities include enabling ML use cases and orchestrating data workflows. The position requires a strong background in data engineering and familiarity with big data tools.

Key Responsibilities:

• Build scalable data pipelines to support Machine Learning use cases.
• Work with cloud-based data platforms for advanced analytics.
• Utilize AWS services such as S3, Glue, Redshift, Lambda, and EMR.
• Implement ETL/ELT frameworks and orchestrate data workflows.
• Collaborate on data warehousing and data lake strategies.

Key Skills:

• 5+ years of experience in Data Engineering.
• Strong programming skills in Python and SQL.
• Hands-on experience with AWS services.
• Experience with big data tools like Apache Spark, Hadoop, or Kafka.
• Knowledge of Machine Learning concepts and model lifecycle.
• Experience with ETL/ELT frameworks.
• Strong understanding of data warehousing and data lakes.
• Familiarity with ML frameworks (TensorFlow, PyTorch, Scikit-learn) is preferred.
• Knowledge of Docker and Kubernetes.
• Experience in real-time streaming (Kafka, Kinesis).
• Exposure to CI/CD and DevOps practices.

Salary (Rate): £60,000 yearly

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT