Mid-Level Databricks Engineer (Alteryx)

Job Description

We are looking for a skilled Mid-Level Databricks Engineer with hands-on experience in Alteryx and Databricks to join our data engineering team. The ideal candidate will have strong experience in data transformation, ETL/ELT development, data pipeline creation, and cloud-based data processing.

The candidate should be comfortable working with large datasets, building scalable data solutions, and optimizing data workflows using Alteryx and Databricks.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Databricks.
• Build and optimize ETL/ELT workflows using Alteryx.
• Develop data transformation solutions using Python, PySpark, and SQL.
• Work with Databricks notebooks, Delta Lake, and data processing frameworks.
• Integrate data from multiple sources into centralized data platforms.
• Perform data cleansing, validation, transformation, and quality checks.
• Optimize data pipelines for performance, scalability, and reliability.
• Collaborate with data engineers, analysts, and business stakeholders.
• Troubleshoot data pipeline issues and ensure smooth data operations.
• Follow best practices for data governance, security, and documentation.

Required Skills & Qualifications

• Strong hands-on experience with Databricks.
• Practical experience with Alteryx Designer and workflow development.
• Proficiency in Python, PySpark, and SQL.
• Experience developing and maintaining ETL/ELT pipelines.
• Knowledge of Delta Lake and Databricks architecture.
• Experience working with cloud data platforms such as Azure, AWS, or Google Cloud Platform.
• Strong understanding of data warehousing and data modeling concepts.
• Excellent analytical and problem-solving skills.
• Ability to work independently in a remote environment.

Preferred Qualifications

• Experience with Azure Databricks.
• Knowledge of Azure Data Factory or similar orchestration tools.
• Familiarity with CI/CD and version control tools such as Git.
• Experience with data lakehouse architecture.