Lead Data Engineer
Posted 4 days ago by 1756534529
Negotiable
Outside
Remote
USA
Summary: The Lead Data Engineer role focuses on designing and developing scalable data pipelines primarily using Azure Data Services and DBT, with additional expertise in Snowflake and Snowflake Cortex. The position requires a strong emphasis on data quality, governance, and supporting AI-driven analytics. The ideal candidate will thrive in a cloud-native environment and collaborate across engineering and analytics teams. This is a remote position requiring over 10 years of experience in data engineering.
Key Responsibilities:
- Design, build, and optimize scalable data pipelines using Azure Data Factory, DBT, and Databricks.
- Develop modular, testable DBT models for data transformation and analytics.
- Implement data orchestration and workflow automation in Azure environments.
- Ensure high performance, reliability, and scalability of data workflows.
- Build and maintain Snowflake-based data architectures and pipelines.
- Leverage Snowflake Cortex functions for anomaly detection, time-series forecasting, classification, text completion, embedding, sentiment analysis, and summarization.
Key Skills:
- Lead Data Engineers
- Azure
- DBT
- Snowflake
- Cortex
- LLM
- Python
- Gen AI
- SQL
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: Senior
Industry: IT
Job Title : Lead Data Engineers with Azure
Location: 100% Remote
Years of experience: 10+ Years
Skills required: Lead Data Engineers, Azure, DBT, Snowflake, Cortex, LLM, Python, Gen AI,Python, SQL
We are looking for a highly experienced Senior Data Engineer with a strong focus on Azure Data Services and DBT, complemented by expertise in Snowflake and Snowflake Cortex. The ideal candidate will lead the design and development of scalable data pipelines, ensure data quality and governance, and support AI-driven analytics using Snowflake Cortex and GenAI capabilities. This role is ideal for someone who thrives in a cloud-native, data-first environment and enjoys working across engineering and analytics teams.
Key Responsibilities
Azure & DBT-Focused Data Engineering
Design, build, and optimize scalable data pipelines using Azure Data Factory, DBT, and Databricks.
Develop modular, testable DBT models for data transformation and analytics.
Implement data orchestration and workflow automation in Azure environments.
Ensure high performance, reliability, and scalability of data workflows.
Snowflake & Cortex Integration
Build and maintain Snowflake-based data architectures and pipelines.
Leverage Snowflake Cortex functions for:
o Anomaly Detection, Time-Series Forecasting, Classification
o Text Completion, Embedding, Sentiment Analysis, Summarization