Data Engineer
Posted 2 days ago by Experis
£470 Per day
Inside
Remote
London
Summary: The Data Engineer role involves working remotely in the UK for a duration of 6 months, requiring active SC clearance. The position demands a strong understanding of data concepts, data security principles, and experience with data pipelines using Python/PySpark frameworks. The role emphasizes problem-solving and analytical skills, particularly in handling complex data structures and sensitive datasets.
Key Responsibilities:
- Strong understanding of data concepts including data types, structures, and schema management.
- Experience with complex JSON manipulation.
- Working with data pipelines using custom Python/PySpark frameworks.
- Managing and handling Reference Data across core data categories.
- Applying data security principles and handling sensitive datasets.
- Demonstrating strong problem-solving and analytical skills.
Key Skills:
- Proficient in JSON, YAML, Python, SQL, PySpark, Delta Lake, Bash, Git, Markdown, and Scala (bonus).
- Experience with Azure SQL Server as a HIVE Metastore (bonus).
- Familiarity with Azure Databricks, Apache Spark, Delta Tables, and PowerBI.
- Experience with JIRA for project management.
Salary (Rate): 470
City: London
Country: UK
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT