Data Engineer
Posted 2 days ago by Infoplus Technologies UK Ltd on JobServe
Negotiable
Undetermined
Remote
London, United Kingdom
p>Role: Data Engineer
Location: London, UK - Remote
Job Description:
Key Accountabilities
Location: London, UK - Remote
Job Description:
Key Accountabilities
- Strong understanding of data concepts
- data types, data structures, schemas (both JSON and Spark), schema management etc
- Strong understanding of complex JSON manipulation - Experience working with Data Pipelines using a custom Python/PySpark frameworks
- Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
- Strong understanding of Data Security principles
- data owners, access controls
- row and column level, GDPR etc including experience of handling sensitive datasets
- Strong problem solving and analytical skills, particularly able to demonstrate these intuitively