Job Description
6 to 9 Yrs exp Hands-on pipeline engineering — production PySpark/SQL, Delta Live Tables or dbt, ADF and Databricks/Snowflake Workflows orchestration
Rapid POCs & reusable accelerators — proving pillar designs with working prototypes; ingestion, DQ and reconciliation frameworks the implementation teams scale
Data profiling, consolidation & optimization — overlap/duplicate analysis, source-to-target mapping at scale, Spark tuning and Databricks/Snowflake cost control
Delivery engineering & BI enablement — CI/CD and automated testing; visualization semantic models and SQL layers for Avery reporting
Enabling data for AI consumption — semantic layer, context layer and knowledge graph enablement
AI-assisted productivity — GenAI tooling for code conversion, tests and documentation; strong written English, async handoffs, reliable overlap hours