Data Engineer - Migration to Databricks - Inside I

Data Engineer - Migration to Databricks - Inside I

Posted 4 days ago by Gigged.AI on Linkedin

Negotiable
Inside
Remote
United Kingdom

Summary: The role of Data Engineer - Migration to Databricks involves supporting an enterprise-wide migration project for an energy client, focusing on creating data products and capabilities. The position requires collaboration with client teams and consultant engineers, with a contract duration of 3 months and potential for extension. The role is primarily remote, with rare ad-hoc travel for workshops. Key technical skills in Databricks, PySpark, and Spark SQL are essential for success in this position.

Key Responsibilities:

  • Support the migration of data to Databricks for an energy client.
  • Create data products, blocks, and marts for specific business units.
  • Engage with clients for requirements gathering and specifications for new data products.
  • Work alongside client teams and consultant engineers from Optima.
  • Handle both migration from legacy systems and development of new capabilities.

Key Skills:

  • Strong skills in Databricks, PySpark, and Spark SQL.
  • Data modeling capability.
  • Ability to engage with clients for requirements gathering.
  • Experience in creating data products and specifications.

Salary (Rate): undetermined

City: undetermined

Country: United Kingdom

Working Arrangements: remote

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT