
Azure Data Architect/Sr. Data Engineer (100% Remote Contract Opportunity - only)
Posted 3 days ago by 1753798338
Negotiable
Outside
Remote
USA
Summary: The Azure Data Architect/Sr. Data Engineer role is a long-term remote contract position focused on designing and building scalable data pipelines for real-time and batch data processing. The position requires technical leadership to guide team members in the development of streaming applications and the adoption of new tools and best practices. Candidates must possess extensive experience in data integration and manipulation, particularly with Microsoft Synapse and Databricks. The role also involves mentoring and ensuring successful project implementation across the organization.
Key Responsibilities:
- Design and build highly scalable data pipelines for near real-time and batch data ingestion, processing, and data integration
- Technical leadership and knowledge to provide technical guidance and educate team members and coworkers on development and operations of streaming and event driven applications
- Be a hands-on mentor and advocate to ensure successful adoption of new tools, processes, and best practices across the organization
- Communicate and own the process of manipulating and merging large datasets
- Prepare advanced project implementation plans which highlight major milestones and deliverables, leveraging standard methods and work planning tools
- Expertise in Microsoft Synapse and Databricks
- Take queries and translate them into the other environments, help with the data validation
- Bringing data from on-prem onto the cloud and doing comparisons
Key Skills:
- Minimum 10+ years of experience with Bachelors Degree in Information Systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience
- Expert level skills in Python, Databricks, Azure Data Factory, Azure Data Lake, Apache Parquet, Microsoft Azure Synapse Workspaces.
- Additional Skills required - Microsoft TSQL, Azure Data Lake Storage, Pipelines, Workflows, Git/Github, YAML, EntraID, PowerBI, SQL Reporting Services, PySpark, SparkSQL, and PowerApps.
- Experienced in the use of ETL tools and techniques and have knowledge of CI/CD
- Experience in cloud NoSQL databases, ideally Azure/Azure Data Services/Cosmos DB or equivalent
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
Location: Remote (ability to work in EST timezone)
Duration: Long term contract role
Responsibilities:-
- Design and build highly scalable data pipelines for near real-time and batch data ingestion, processing, and data integration
- Technical leadership and knowledge to provide technical guidance and educate team members and coworkers on development and operations of streaming and event driven applications
- Be a hands-on mentor and advocate to ensure successful adoption of new tools, processes, and best practices across the organization
- Communicate and own the process of manipulating and merging large datasets
- Prepare advanced project implementation plans which highlight major milestones and deliverables, leveraging standard methods and work planning tools
- Expertise in Microsoft Synapse and Databricks
- Take queries and translate them into the other environments, help with the data validation
- Bringing data from on-prem onto the cloud and doing comparisons
Qualifications and Education Requirements:
- Minimum 10+ years of experience with Bachelors Degree in Information Systems, Computer Science, Engineering, or related field, or the equivalent combination of education, training and experience
- Expert level skills in Python, Databricks, Azure Data Factory, Azure Data Lake, Apache Parquet, Microsoft Azure Synapse Workspaces.
- Additional Skills required - Microsoft TSQL, Azure Data Lake Storage, Pipelines, Workflows, Git/Github, YAML, EntraID, PowerBI, SQL Reporting Services, PySpark, SparkSQL, and PowerApps.
- Experienced in the use of ETL tools and techniques and have knowledge of CI/CD
- Experience in cloud NoSQL databases, ideally Azure/Azure Data Services/Cosmos DB or equivalent