Big Data Engineer/Lead
Posted 3 days ago by L&G Recruitment UK on JobServe
Negotiable
Undetermined
Undetermined
London, UK
Summary: The role of Big Data Engineer/Lead requires senior-level expertise in data engineering, specifically in building automated data pipelines using DataStage, AWS, and Databricks. The position emphasizes the use of modern cloud technologies to manage data from source to operational databases and through to the curation layer. Candidates should be well-versed in the latest tools and practices in the field.
Key Responsibilities:
- Design and implement automated data pipelines using DataStage, AWS, and Databricks.
- Manage data flow from source systems to operational databases and curation layers.
- Utilize modern cloud technologies to enhance data processing and management.
- Collaborate with cross-functional teams to ensure data integrity and accessibility.
Key Skills:
- Databricks, AWS (S3, Glue, RDS, Lambda), DataStage & DB2
- Python, SQL, ETL/ELT tools
- Familiarity with DevOps practices for data engineering
- Big data technologies like Apache Spark, Hadoop, or similar
Salary (Rate): undetermined
City: London
Country: UK
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: Senior
Industry: IT