Data Engineer Databricks, AWS & Power BI Development

Job Summary

We are looking for a strong Databricks Engineer with hands-on Power BI Development experience to build and optimize data engineering solutions, develop custom Power BI dashboards, and leverage AI/BI capabilities within Databricks for rapid dashboard development.

The ideal candidate will have strong Databricks engineering and development skills, AWS cloud experience, backend database development expertise, and the ability to deliver end-to-end data solutions, from data pipelines and database development to dashboards and reporting.

Key Responsibilities

• Develop, maintain, and optimize data pipelines and data processing solutions using Databricks.
• Design and develop ETL/ELT workflows, data transformations, and scalable data engineering solutions.
• Develop custom Power BI dashboards, reports, and interactive visualizations based on business requirements.
• Leverage Databricks AI/BI capabilities to rapidly create dashboards and deliver self-service analytics solutions.
• Develop and optimize backend database components, SQL queries, data models, and reporting datasets.
• Integrate Databricks with AWS services and other data sources to support analytics and reporting.
• Build and maintain data models that support efficient dashboard development and business intelligence.
• Optimize Databricks workloads, SQL queries, and Power BI dashboard performance.
• Collaborate with business and technical teams to translate requirements into data engineering and dashboard solutions.
• Troubleshoot data pipeline, database, and reporting issues to ensure reliability and performance.

Required Skills & Qualifications

• Strong hands-on experience in Databricks Engineering and Development.
• Practical experience developing custom dashboards and reports using Microsoft Power BI.
• Experience with Databricks AI/BI dashboards and related capabilities for rapid dashboard development.
• Strong SQL skills, including backend database development, query optimization, and data modeling.
• Experience building ETL/ELT pipelines and data transformation workflows.
• Strong understanding of data engineering, data warehousing, and analytics solutions.
• Experience working with AWS cloud services, particularly AWS S3 and other relevant data services.
• Ability to connect data engineering solutions with BI dashboards and reporting platforms.
• Strong problem-solving skills and the ability to work independently in a remote environment.

Preferred Skills

• Experience with PySpark, Apache Spark, and Delta Lake.
• Familiarity with Databricks Unity Catalog and workflow orchestration.
• Experience with Power BI DAX, data modeling, and dashboard performance optimization.
• Knowledge of AWS Glue, Redshift, and Lambda.
• Experience implementing end-to-end data solutions from backend development to business-facing dashboards.