Pyspark Developer

Pyspark Developer

Posted Today by LA International

£350 Per day
Inside
Undetermined
North West

Summary: The role of Pyspark Developer involves utilizing expert proficiency in PySpark, Hadoop, and Python to develop data pipelines and ETL processes. The position requires a strong understanding of data engineering concepts and is based in Knutsford, Cheshire, for a duration of 6 months or more. The role is classified as inside IR35, with a daily rate of £350. Candidates should have over 5 years of relevant experience.

Key Responsibilities:

  • Develop and maintain data pipelines using PySpark and Hadoop.
  • Implement ETL processes and data warehousing solutions.
  • Utilize SQL for data manipulation and querying.
  • Collaborate with teams to ensure efficient data flow and integration.
  • Work with AWS Glue for additional data processing tasks.

Key Skills:

  • Expert proficiency in PySpark, Hadoop, and Python.
  • Strong understanding of data engineering concepts and ETL processes.
  • Experience with data warehousing and data pipelines.
  • Proficient in SQL.
  • 5+ years of relevant experience.
  • Knowledge of AWS Glue is a plus.

Salary (Rate): £350

City: Knutsford

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: Mid-Level

Industry: IT