Lead Data Engineer(Hadoop / Spark / Splunk / Cybersecurity)
Posted Today by GIOS Technology
Negotiable
Undetermined
Hybrid
Sheffield, England, United Kingdom
Summary: The Lead Data Engineer role focuses on leveraging extensive experience with Hadoop, Spark, and Splunk to manage large-scale data systems. The position requires strong programming skills in Python and a solid understanding of cybersecurity and data privacy regulations. The role is hybrid, requiring three days per week in the office in Sheffield. Candidates should be familiar with modern data integration tools and Agile methodologies.
Key Responsibilities:
- Utilize Hadoop, Spark, and Splunk for data engineering tasks.
- Develop and maintain large-scale structured and unstructured data systems.
- Implement CI/CD and DevOps practices in data processing workflows.
- Ensure compliance with data privacy and cybersecurity regulations.
- Collaborate in Agile teams using methodologies such as Scrum or Kanban.
Key Skills:
- Hadoop
- Spark
- Splunk
- Python
- Cybersecurity
- Data processing
- Data privacy
Salary (Rate): undetermined
City: Sheffield
Country: United Kingdom
Working Arrangements: hybrid
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
I am hiring for Lead Data Engineer(Hadoop / Spark / Splunk / Cybersecurity) Location: Sheffield - Hybrid / 3 days Per week in Office Extensive enterprise experience with Hadoop, Spark, and Splunk. Strong programming expertise in Python (object-oriented and functional paradigms). Proven experience working with large-scale structured and unstructured data systems (SQL and NoSQL). Deep knowledge of modern data integration tools and distributed data processing frameworks. Strong understanding of CI/CD, DevOps practices, and automated testing frameworks. Experience in Agile methodologies such as Scrum or Kanban. Solid understanding of cybersecurity, data privacy, consent management, and data residency regulations. Key Skills: Hadoop / Spark / Splunk / Python / Cyber security / Data processing / Data privacy