Data Engineer - Hartford, CT, Princeton, NJ, Newark, NJ, New York City, NY, Boston, MA.

Job Summary

We are seeking a Senior Data Engineer with expertise in modern Lakehouse architecture, Databricks, Delta Lake, Snowflake, and Apache Iceberg. The ideal candidate will design and build scalable cloud-native data platforms supporting enterprise analytics, AI/ML, and Generative AI initiatives.

Key Responsibilities

• Design enterprise Lakehouse architecture.
• Build scalable ETL/ELT pipelines using Databricks.
• Develop PySpark applications for large-scale data processing.
• Build data models using dbt.
• Implement Delta Lake and Apache Iceberg.
• Optimize Snowflake performance.
• Build batch and streaming pipelines.
• Develop reusable data engineering frameworks.
• Implement data governance and quality.
• Support AI/ML data pipelines.

Required Skills

• Python
• SQL
• Databricks
• PySpark
• Snowflake
• Delta Lake
• Apache Iceberg
• dbt
• Apache Airflow
• Git
• Docker
• Azure / AWS / Google Cloud Platform

Preferred Skills

• Unity Catalog
• Kafka
• Data Mesh
• Data Lakehouse
• Great Expectations

Mandatory Skills

• Databricks
• PySpark
• Snowflake
• Delta Lake
• Apache Iceberg
• dbt
• SQL
• Python
• Airflow
• ETL/ELT