Job Summary
We are looking for a hands-on DevOps Engineer to support Data Engineering workloads running on Microsoft Azure. The engineer will focus on CI/CD automation, Jenkins pipeline engineering, release management, source control, environment management, and deployment automation, working closely with Data Engineers and cloud/platform teams.
Key Responsibilities
- Design, develop, maintain, and troubleshoot Jenkins CI/CD pipelines supporting Azure-based data engineering solutions.
- Automate build, test, deployment, configuration, and release processes across development, test, QA, and production environments.
- Support deployment/release processes for Azure data workloads, including Azure Data Factory, Azure Databricks, Azure Storage/Data Lake, and related services.
- Partner with Data Engineers to incorporate data pipelines, notebooks, scripts, configuration, and infrastructure changes into repeatable deployment processes.
- Manage Git branching, merging, pull requests, artifacts, and release processes.
- Build pipeline-as-code and reusable automation to reduce manual deployment activities.
- Troubleshoot failed builds, deployments, permissions, dependencies, credentials, and environment/configuration issues.
- Support Azure identity, secrets, service connections, and secure access required by automated pipelines.
- Implement deployment controls, approvals, logging, and traceability throughout the CI/CD lifecycle.
- Support production deployments, operational troubleshooting, incident resolution, and root-cause analysis.
- Maintain pipeline documentation, operational procedures, and support runbooks.
Participate actively in Agile/Scrum ceremonies, including sprint planning, stand-ups, backlog refinement, estimation, demos, retrospectives, and continuous improvement.
Skill Requirements
- Strong hands-on Jenkins experience
- CI/CD pipeline design, development, administration, and troubleshooting
- Microsoft Azure experience
- DevOps automation supporting data engineering workloads
- Git and enterprise source-control practices
- PowerShell, Bash, and/or Python scripting
- Azure Data Factory and/or Azure Databricks deployment experience
- Automated build, test, deployment, and release-management experience
- Agile/Scrum delivery experience
Other Requirements
- Azure Databricks
- Azure Data Factory (ADF)
- Microsoft Fabric
- Azure Data Lake / Storage
- Azure DevOps
- Terraform / Infrastructure as Code
- Docker and Kubernetes
- YAML / JSON
- SQL and ETL/ELT understanding
- Monitoring/logging for CI/CD and Azure workloads
- Jira or Azure Boards experience
Rate:
Not specified
Location:
Remote or Connecticut
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
IT
Seniority Level:
Senior