Databricks Developer

Position Overview

We are seeking an experienced Mid - Senior Databricks Developer with 8–10+ years of industry experience to design, develop, and optimize large-scale data solutions.

The ideal candidate will have strong expertise in Databricks, Python, SQL, and Microsoft Azure cloud services.

A minimum of a Bachelor’s degree is required.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL workflows using Databricks.
• Build and optimize Delta Lake architectures and data models.
• Develop high-quality, reusable code in Python for data processing and automation.
• Write and optimize complex SQL queries for large datasets.
• Implement and manage solutions on Microsoft Azure, including Azure Data Lake, Azure Data Factory, and related services.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver high-quality solutions.
• Ensure data quality, reliability, and performance across all pipelines.
• Troubleshoot production issues and perform root-cause analysis.
• Follow best practices for version control, CI/CD, and cloud security.

Required Qualifications

• Bachelor’s degree in Computer Science, Information Technology, Engineering, or a related field (minimum requirement).
• 8–10+ years of experience in data engineering or software development.
• Strong hands-on experience with Databricks (including notebooks, jobs, clusters, Delta Lake).
• Advanced proficiency in Python for data engineering.
• Strong expertise in SQL, including performance tuning.
• Solid experience with Microsoft Azure cloud services.
• Experience working with large-scale distributed data systems.
• Strong problem-solving skills and ability to work independently.

Preferred Skills (Nice to Have)

• Experience with CI/CD tools (Azure DevOps, GitHub Actions).
• Knowledge of Spark performance optimization.
• Experience with data governance and security frameworks.
• Familiarity with Agile methodologies.