Summary: The Data Engineer role at Whitehall Resources involves working with a key client on a 6-month contract, initially requiring full-time on-site presence in London for the first month, transitioning to a hybrid model thereafter. The position emphasizes end-to-end responsibility for data products, a DevOps mindset, and proficiency in GCP tools and data modeling techniques. Candidates should possess strong communication skills and a collaborative approach while being motivated to work independently. The role is classified as outside IR35.

Key Responsibilities:

• Take end-to-end responsibility to build, optimize and support existing and new data products.
• Champion DevOps principles and manage CI/CD pipelines and terraform.
• Evaluate and drive continuous improvement and reduce technical debt.
• Design and implement efficient data models and data pipelines.
• Work with data query languages (SQL or similar) and ETL processes.
• Engage in data-centric and API programming using Python, Java, or Scala.
• Utilize NoSQL and RDBMS databases and various data formats (Avro, Parquet).
• Collaborate effectively and communicate well with team members.
• Work with data visualization tools and analytical tools like PowerBI.
• Exhibit understanding in creating intermediate-level DAX measures.
• Have hands-on experience with GCP tools such as Cloud Function, Dataflow, Dataproc, and BigQuery.
• Experience in data processing frameworks like Beam, Spark, Hive, and Flink.
• Possess GCP data engineering certification as a merit.

Key Skills:

• Several years of relevant work experience.
• Strong understanding of data modeling techniques.
• Experience with data query languages (SQL or similar).
• Knowledge of ETL processes and tools.
• Proficiency in programming languages such as Python, Java, or Scala.
• Familiarity with NoSQL and RDBMS databases.
• Experience with data formats like Avro and Parquet.
• Excellent communication and collaboration skills.
• Ability to work independently and make decisions.
• Experience with data visualization tools and analytical tools like PowerBI.
• Understanding of DAX measures and Microsoft Excel.
• Experience with GCP tools and data processing frameworks.
• GCP data engineering certification is a merit.

Salary (Rate): undetermined

City: City of London

Country: UK

Working Arrangements: hybrid

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT