All Jobs Vacancy

Azure Data Engineer- Databricks

Posted 1 day ago by Intuition IT Solutions Ltd

Key Responsibilities

  • Design and develop data pipelines using Azure Data Factory (ADF).
  • Build and optimize data processing solutions using Azure Databricks and PySpark.
  • Develop and maintain Azure Synapse Analytics and data warehouse solutions.
  • Create and optimize SQL queries, stored procedures, and database objects.
  • Integrate data from multiple sources including APIs, files, and databases.
  • Ensure data quality, governance, security, and performance optimization.
  • Implement CI/CD pipelines and automate deployments.
  • Collaborate with Data Analysts, Data Scientists, and Business teams.

Mandatory Skills

  • Microsoft Azure Cloud
  • Azure Data Factory (ADF)
  • Azure Databricks
  • PySpark
  • Azure Synapse Analytics
  • SQL/T-SQL
  • ETL/ELT Development
  • Data Warehousing & Dimensional Modeling
  • Azure Data Lake Storage (ADLS Gen2)
  • Git, Azure DevOps
Rate:
Not specified
Location:
London
IR35 Status:
Inside
Remote Status:
Not specified
Industry:
Data & Analytics
Seniority Level:
Not Specified

Take-Home Pay

Not Available

Visit calculators for additional details

Share job