Negotiable
Outside
Remote
USA
Summary: We are looking for a skilled Data Engineer with extensive experience in Azure data services and automation frameworks. The candidate should possess expertise in Azure Synapse, SQL Server, ADLS Gen2, PowerShell automation, and distributed data processing using Spark. Prior experience with Microsoft Fabric reporting and a solid understanding of data storage and recovery processes is preferred.
Key Responsibilities:
- Design, build, and maintain Azure-based data solutions including Synapse, IAAS VM, SQL Server, and ADLS Gen2.
- Develop, maintain, and debug Azure Automation account runbooks using PowerShell.
- Perform SQL Server database backup and restore using Azure Storage Accounts and on-prem environments.
- Implement and optimize distributed data processing pipelines using Spark and related technologies.
- Work with data storage formats such as Parquet and Delta Lake for efficient data management.
- Collaborate with cross-functional teams in a remote, agile environment aligned to PST hours.
Key Skills:
- Azure Synapse Analytics, IAAS VM, SQL Server, ADLS Gen2
- Azure Automation Runbooks using PowerShell
- SQL programming and OOPS concepts
- Spark and Scala programming
- Strong understanding of distributed computing concepts
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Role: Data Engineer
Location: Remote
We are seeking an experienced Data Engineer with strong hands-on expertise in Azure data services and automation frameworks. The ideal candidate will have a blend of skills across Azure Synapse, SQL Server, ADLS Gen2, PowerShell automation, and distributed data processing using Spark. Candidates with prior experience in Microsoft Fabric reporting and a solid understanding of data storage, backup, and recovery processes will be highly preferred.
Responsibilities:
- Design, build, and maintain Azure-based data solutions including Synapse, IAAS VM, SQL Server, and ADLS Gen2.
- Develop, maintain, and debug Azure Automation account runbooks using PowerShell.
- Perform SQL Server database backup and restore using Azure Storage Accounts and on-prem environments.
- Implement and optimize distributed data processing pipelines using Spark and related technologies.
- Work with data storage formats such as Parquet and Delta Lake for efficient data management.
- Collaborate with cross-functional teams in a remote, agile environment aligned to PST hours.
Required Skills:
- Azure Synapse Analytics, IAAS VM, SQL Server, ADLS Gen2
- Azure Automation Runbooks using PowerShell
- SQL programming and OOPS concepts
- Spark and Scala programming
- Strong understanding of distributed computing concepts
Preferred Qualifications:
- Experience with Microsoft Fabric-based reporting
- Microsoft Certified (Azure Data Engineer Associate or equivalent)