Azure Data Engineer (AI / ML)

Summary: The Azure Data Engineer role focuses on developing data pipelines and solutions for a leading consulting organization and Digital FS Fintech client, emphasizing AI and Machine Learning expertise. Candidates should possess strong experience with Azure technologies and a solid understanding of the Data Engineering Lifecycle. The position requires knowledge of various AIML platforms and frameworks, as well as practical experience in implementing machine learning models. This role is classified as inside IR35.

Key Responsibilities:

• Create data pipelines through all layers from generation, ingestion, transformation, and serving.
• Build data solutions using Azure technologies including Azure Data Lake Storage Gen2, Azure Databricks, Azure Data Factory, and Azure Synapse.
• Implement machine learning platforms and work with unstructured data using NLP.
• Utilize AIML platforms such as DataRobot, Dataiku, Anaconda, Sagemaker, and Vertex.
• Develop using AIML frameworks like MLFlow, KubeFlow, BentoML, and TensorFlow.
• Work with AIML development tools including PyTorch, Jupyter Notebooks, and XGBoost.
• Implement various AIML models including Linear/Logistic Regression, KNN, Decision Trees, and Generative Models.

Key Skills:

• Excellent experience in the Data Engineering Lifecycle.
• Strong experience with Azure technologies and data solutions.
• Azure certified Data Engineer/Architect.
• Knowledge of Machine Learning and NLP.
• Experience with AIML platforms and frameworks.
• Proficiency in AIML development tools and models.

Salary (Rate): undetermined

City: Greater London

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT