Data Engineer
Posted 3 days ago by Whitehall Resources
Negotiable
Outside
Hybrid
City of London, London
Summary: The Data Engineer role at Whitehall Resources involves working with a key client on a 6-month contract, initially requiring full-time on-site presence in London for the first month, transitioning to a hybrid model thereafter. The position emphasizes end-to-end responsibility for data products, a DevOps mindset, and proficiency in Google Cloud Platform tools. Candidates should possess extensive experience in data engineering, data modeling, and programming languages relevant to data processing.
Key Responsibilities:
- Take end-to-end responsibility to build, optimize, and support existing and new data products.
- Manage CI/CD pipelines and terraform as well as Cloud infrastructure, specifically GCP.
- Design and implement efficient data models and data pipelines that support analytical requirements.
- Evaluate and drive continuous improvement while reducing technical debt.
- Collaborate effectively and communicate with team members.
- Work independently in a motivated environment.
- Utilize data visualization tools and analytical tools such as PowerBI.
- Exhibit understanding in creating intermediate-level DAX measures to enhance data models and visualizations.
Key Skills:
- Several years of relevant work experience in data engineering.
- Experience with data modeling and data query languages (SQL or similar).
- Proficiency in programming languages such as Python, Java, or Scala for data-centric and API programming.
- Knowledge of NoSQL and RDBMS databases.
- Experience with data formats like Avro and Parquet.
- Familiarity with GCP tools including Cloud Function, Dataflow, Dataproc, and BigQuery.
- Experience in data processing frameworks such as Beam, Spark, Hive, and Flink.
- GCP data engineering certification is a merit.
Salary (Rate): undetermined
City: City of London
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT