Summary: Gibbs Hybrid is seeking a skilled Big Data Engineer with strong Spark and Scala experience for a 6-month contract in the financial services sector. Candidates must have prior experience in financial services and will work in a hybrid model, requiring two days on-site each week. The role demands extensive hands-on experience with data processing applications and a strong background in ETL and Big Data technologies.

Key Responsibilities:

• Develop data processing applications using Apache Spark and Scala.
• Build complex data transformation workflows utilizing Hadoop ecosystem tools.
• Query and manage large datasets with Hive, Impala, and HBase.
• Optimize Spark jobs for efficiency and performance.
• Work with Java and distributed computing environments.
• Troubleshoot performance bottlenecks in data processing.

Key Skills:

• Extensive hands-on experience with Spark and Scala.
• Strong experience in ETL and Big Data technologies.
• Proficiency in Hive, Impala, and HBase.
• Practical experience in performance tuning of Spark jobs.
• Experience with Java and distributed computing.
• 5+ years of experience in relevant technologies.
• Strong problem-solving skills.
• Prior experience in enterprise-scale data solutions.

Salary (Rate): £420

City: Northampton

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: inside IR35

Seniority Level: Mid-Level

Industry: IT