All Jobs Vacancy

AI Data Engineer

Posted 1 day ago by QUANTUM TECHNOLOGIES LLC

Job Descriptions

Client is seeking a highly skilled Senior Python / AI Data Engineer with strong expertise in advanced Python development, OpenAI integrations, and cloud-native data engineering on AWS. The ideal candidate will have deep experience building scalable data pipelines, AI-driven solutions, and production-grade ETL systems.

Key Responsibilities

  • Design, develop, and optimize advanced Python applications for data and AI use cases.
  • Build and integrate OpenAI-based solutions (LLMs, prompt engineering, APIs, embeddings).
  • Develop and maintain ETL/data pipelines for large-scale data processing.
  • Implement workflow orchestration using Apache Airflow.
  • Work with AWS services, including Helix (internal platforms if applicable), data services, and cloud infrastructure.
  • Manage CI/CD pipelines using Harness.
  • Collaborate with data scientists, analysts, and business teams to deliver high-quality data solutions.
  • Ensure best practices for performance, security, scalability, and reliability.

Required Skills & Qualifications

  • Strong and advanced Python development experience.
  • Hands-on experience with OpenAI / Generative AI APIs.
  • Solid experience with AWS cloud services.
  • Proven expertise in Airflow for orchestration.
  • Experience with Harness for CI/CD.
  • Strong ETL and data engineering skills (data modeling, transformations, pipelines).
  • Strong SQL and data analysis capabilities.
  • Experience working in Agile/DevOps environments.

Preferred Qualifications

  • Prior experience in financial services or investment management domains.
  • Exposure to large-scale, enterprise data platforms.
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
AI & Machine Learning
Seniority Level:
Senior

Take-Home Pay

Not Available

Visit calculators for additional details

Share job