Data Engineer (Azure Databricks)

Data Engineer (Azure Databricks)

Posted 1 week ago by Next Ventures

Negotiable
Undetermined
Remote
, Philippines

Summary: The Data Engineer (Azure Databricks) role involves designing and implementing scalable data pipelines using Azure technologies for a leading semiconductor manufacturer. The position emphasizes experience with Azure Data Services and Databricks, offering a long-term remote working opportunity. Candidates should have a strong background in data engineering and cloud technologies. This role is critical for optimizing data workflows and enhancing data processing efficiency.

Key Responsibilities:

  • Design, develop, and implement scalable data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse Analytics.
  • Build and optimize ETL/ELT workflows for efficient data ingestion, transformation, and processing.
  • Develop data models and implement best practices for data warehousing and lakehouse architectures.
  • Optimize Apache Spark jobs in Databricks for performance and cost-efficiency.

Key Skills:

  • 3-4+ years of experience as a Data Engineer, with a strong focus on Azure cloud technologies.
  • Hands-on experience with Azure Databricks, Apache Spark, PySpark, and Delta Lake.
  • Proficiency in SQL, Python, or Scala for data processing and automation.
  • Experience with Azure Data Factory, Azure Synapse Analytics, and Azure Blob Storage.
  • Solid understanding of data modeling, ETL processes, and data warehousing concepts.

Salary (Rate): undetermined

City: undetermined

Country: Philippines

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT