Senior Databricks Developer / Engineer

Position Overview

We are seeking an experienced Senior Databricks Developer / Data Engineer for an enterprise financial-services technology environment.

Required Skills

• Overall IT Experience: 8 years
• Databricks: 5 years
• Apache Spark / PySpark: 5 years
• Cloud Platform (AWS / Azure / Google Cloud Platform): 5 years
• ETL / ELT Development: 6 years
• Data Pipeline Development: 6 years
• Python Programming: 5 years
• SQL: 6 years
• Delta Lake / Delta Tables: 4 years
• Data Modeling: 5 years

Additional preferred skills

• AWS S3 / Glue / Lambda: 3+ years
• Unity Catalog: 2+ years
• CI/CD and Git: 3+ years
• Apache Airflow / Workflow Orchestration: 2+ years
• Production Support / Performance Tuning: 3+ years
• Banking / Financial Services: 2+ years

Technical Responsibilities

• Design, develop, test, and maintain enterprise Databricks data pipelines.
• Develop scalable ETL/ELT solutions using Python, PySpark, SQL, and Delta Lake.
• Integrate data from multiple enterprise sources.
• Optimize Spark jobs, SQL queries, and Databricks workloads.
• Implement data quality, validation, and reconciliation controls.
• Support data governance, security, access controls, and lineage.
• Support production monitoring, troubleshooting, and root-cause analysis.
• Collaborate with architecture, analytics, business, and technology teams.

Additional Preferred Skills

• AWS S3, Glue, Lambda, and IAM.
• Unity Catalog and metadata management.
• Batch and streaming data processing.
• Apache Airflow or equivalent workflow orchestration.
• CI/CD, Git, Jenkins, or Bitbucket.
• Production monitoring and performance tuning.
• Financial services, banking, payments, risk, or compliance experience.

Work Requirements

• Must be available for W2 contract employment.
• Must be able to work onsite five days per week in Delaware, OH.
• Local candidates are preferred.

Candidate Information

Candidates must provide their current location, total IT experience, individual years of experience across required technologies, W2 availability, and confirmation of the five-day onsite requirement.