Negotiable
Outside
Onsite
Edinburgh, UK
Lorien is recruiting for a Cloud Data Engineer on a initial 6 month contract.
Main Responsibilities
. Implement the data pipelines that handle the ETL processes in the AWS environment.
. Automate the nightly data transfer from on-premises Oracle databases to the AWS environment.
. Collaborate with the ETL Engineer to ensure seamless integration between the extraction and transformation steps.
. Set up monitoring and logging to track the performance and reliability of the data pipelines.
. Optimize the data ingestion process for performance and scalability.
. Troubleshoot and resolve issues related to data pipelines and ETL processes.
. Document data engineering processes and ensure alignment with best practices.
Key Skills
. Bachelor's degree in Computer Science, Data Engineering, or a related field.
. 3+ years of experience in data engineering, with a focus on ETL pipeline development.
. Proficiency in AWS services like Glue, Lambda, S3, and Redshift.
. Strong programming skills in Python, SQL, or other relevant languages.
. Experience with data pipeline monitoring and performance optimization.
. Knowledge of Oracle database structures and data migration strategies
Carbon60, Lorien & SRG - The Impellam Group STEM Portfolio are acting as an Employment Business in relation to this vacancy.