Top Consulting is seeking an AI Azure Data Engineer/Software Engineer to design, develop, and maintain scalable data platforms, backend services, and AI-enabled applications. This role combines Azure data engineering, Python development, API integration, and cloud-based application architecture to support reliable data processing, analytics, and machine learning solutions.
Responsibilities
- Design, develop, and maintain Azure data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
- Build and optimize data processing solutions using SQL and Python, ensuring data quality, accuracy, and reliability.
- Develop backend services, REST APIs, and application integrations using Python and FastAPI.
- Implement cloud-based solutions using Azure Functions, containerized services, and event-driven architectures.
- Integrate machine learning models into applications and support feature pipelines and model-serving APIs.
- Leverage Azure AI services to support AI-driven applications and emerging agentic architectures.
- Implement automated testing, CI/CD pipelines, and deployment processes using GitHub and related tools.
- Collaborate with data, software engineering, and AI teams to deliver scalable, secure, and maintainable solutions.
Qualifications
- Experience developing data platforms and pipelines within Microsoft Azure.
- Proficiency in Python and SQL for data processing and application development.
- Hands-on experience with Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake Storage Gen2.
- Experience developing REST APIs and backend services using frameworks such as FastAPI.
- Understanding of cloud-based application development, data orchestration, and application integration.
- Experience with GitHub, CI/CD pipelines, automated testing, and software deployment.
- Knowledge of data quality, validation, and reliable data processing practices.
- Experience with Azure Functions, containerized applications, and event-driven architectures.
- Experience integrating machine learning models into applications and supporting model-serving APIs.
- Familiarity with Azure AI services and AI-enabled application development.
- Understanding of agentic application architectures and AI-driven workflows.
- Experience implementing scalable, production-ready data and software solutions in cloud environments.
- Preferred energy industry experienced.
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
IT
Seniority Level:
Not Specified