Data Engineer
Posted 5 days ago by eTeam Workforce Limited
Negotiable
Inside
Hybrid
Birmingham/Hybrid, UK
Summary: The Data Engineer role involves a strong DevOps engineering background with expertise in various tools and technologies, including CI/CD pipelines, Python development, and data engineering practices. The position requires experience in cloud and containerization, as well as strong problem-solving skills and the ability to work independently in a fast-paced environment. The role is based in Birmingham with a hybrid working arrangement and is classified as inside IR35.
Key Responsibilities:
- Develop and maintain CI/CD pipelines using tools like Git, Jenkins, and SonarQube.
- Implement Python libraries and applications, managing dependencies and APIs.
- Design and manage ETL/ELT pipelines and work with data engineering tools such as Spark and Airflow.
- Utilize cloud services and containerization technologies, including GCP, Docker, and Kubernetes.
- Manage secrets and ensure networking and security protocols are followed.
- Support Big Data infrastructure and troubleshoot issues effectively.
- Document processes and share knowledge with team members.
- Collaborate with multi-regional and multi-cultural teams.
Key Skills:
- Strong DevOps engineering background.
- Proficiency in Python and related libraries (Pandas, NumPy).
- Experience with data engineering concepts and tools (ETL/ELT, Spark, Airflow).
- Knowledge of cloud platforms and containerization (GCP, Docker, Kubernetes).
- Understanding of networking, security, and operating systems.
- Experience with Big Data technologies (Hadoop, Spark).
- Strong problem-solving and troubleshooting skills.
- Ability to work independently and under pressure.
Salary (Rate): £402/day
City: Birmingham
Country: UK
Working Arrangements: hybrid
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
We are a Global Recruitment specialist that provides support to the clients across EMEA, APAC, US and Canada. We have an excellent job opportunity for you.
Role Title: Data Engineer
Location: Birmingham/Hybrid
Duration: 31/10/2025
Rate: 402GBP/Day(Inside IR35)
Role Description:
1. Strong DevOps engineering background
a. CICD pipeline
b. Git/Github
c. Github actions/hooks
d. Jenkins
e. SonarQube
f. Linux, eg Redhat
g. Groovy/Bash/Python scripts
h. Nexus
2. Good understanding of Python library and application development
a. Dependency management and package management, eg Poetry, pip
b. Pandas and numpy
c. API, eg Flask, Dash
d. IDE (Pycharm, VsCode) and remote development
3. Good understanding of Data engineering
a. ETL/ELT pipeline
b. Spark
c. Airflow
d. SQL/no-SQL
e. Delta lake
f. Parquet
g. Avro
h. Partitioning
i. Starburst
j. S3 bucket
k. Postgres
l. MLFlow
4. Experience in Cloud and Containerization
a. GCP/Internal cloud
b. Docker/Kubernetes
c. Argo CD
d. Monitoring tooling, eg ELK
e. Service Mesh, eg Istio
5. Experience in secrets management, eg Vault
6. Good understanding of networking, security and operating system
a. TCP/IP
b. DNS
c. SSH
d. SSL/TLS
e. Encryption and tokenization
f. CPU and memory management
7. Experience of supporting Big Data infrastructure
a. Hadoop cluster
b. Spark cluster
c. JDK/JVM
d. Cloudera
8. Strong problem solving and troubleshooting skills
9. Take ownership and able to work independently
10. Able to work under high pressure and in fast-paced environment.
11. Good at documentation and knowledge sharing
12. Able to communicate and work with multi-region/multi-cultural teams
If you are interested in this position and would like to learn more, please send through your CV and we will get in touch with you as soon as possible.
Please note, candidates are often Shortlisted within 48 hours.