Job Description
We are looking for an experienced Azure Data Engineer to design, build, and maintain scalable data pipelines and data solutions using Microsoft Azure services.
Key Responsibilities
- Develop and maintain ETL/ELT data pipelines.
- Build data solutions using Azure Data Factory (ADF).
- Work with Azure Databricks, Azure Synapse Analytics, and Azure Data Lake Storage (ADLS).
- Develop and optimize SQL queries, stored procedures, and data models.
- Perform data transformation, cleansing, and integration.
- Implement data pipelines for batch and real-time processing.
- Monitor, troubleshoot, and optimize data workflows.
- Work with business and technical teams to understand data requirements.
- Ensure data quality, security, and governance.
Required Skills
- Strong experience with Azure Data Engineering.
- Hands-on experience with Azure Data Factory (ADF).
- Strong SQL skills.
- Experience with Azure Databricks and PySpark.
- Knowledge of Azure Data Lake Storage (ADLS).
- Experience with Azure Synapse Analytics.
- Strong understanding of ETL/ELT concepts and data warehousing.
- Experience with Python is preferred.
- Knowledge of Azure cloud security and data governance is a plus.
Preferred Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
- Experience designing enterprise-scale data pipelines.
- Strong problem-solving and analytical skills.