Data Engineer

Summary: The Data Engineer role involves contributing to the development of end-to-end data pipeline solutions on cloud infrastructure, utilizing modern technologies and best practices. The position requires building scalable and secure software solutions while ensuring system reliability and performance optimization. The engineer will support the entire lifecycle of the products developed, including incident management and continuous technology updates.

Key Responsibilities:

• Contribute to end-to-end data pipeline solutions on cloud infrastructure leveraging the latest technologies and best industry practices.
• Use domain modelling techniques to build best-in-class business products.
• Structure software for ease of understanding, testing, and evolution.
• Build solutions that avoid single points of failure using scalable architectural patterns.
• Develop secure code to protect customers and the organization from malicious actors.
• Promptly investigate and fix issues to prevent recurrence.
• Ensure releases occur with zero downtime for end-users.
• Optimize data writing and reading processes for specific needs.
• Monitor performance and apply appropriate problem-solving approaches.
• Ensure systems are reliable and easy to operate.
• Continuously update technologies and patterns.
• Support products throughout their lifecycle, including production and incident management.

Key Skills:

• Formal training or certification in data engineering concepts and applied experience.
• Recent hands-on professional experience as a data engineer.
• Experience coding in a recent version of Python.
• Experience designing and implementing effective tests (unit, component, integration, end-to-end, performance, etc.).
• Excellent written and verbal communication skills in English.
• Understanding of cloud technologies and distributed systems.
• Understanding of data transformation frameworks and data pipeline orchestration tools.
• Understanding of managing and optimizing queries for large volumes of data in various data stores (including relational data stores).
• Experience in a highly regulated environment/industry (preferred).
• Understanding of AWS cloud technologies (preferred).
• Understanding of data governance frameworks (preferred).
• Understanding of event-based architecture, data streaming, and messaging frameworks (preferred).

Salary (Rate): undetermined

City: Greater London

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT