Summary: The Senior Data Engineer role focuses on enhancing the data infrastructure for IoT products in the railway industry, contributing to technical decisions and building scalable data platforms. The position requires collaboration with a cross-functional team to design and improve data solutions, ensuring a seamless user experience. Candidates should have a strong technical background and a passion for data-driven innovation. This role is pivotal as the company transitions from a startup to a global SaaS provider.

Key Responsibilities:

• Design and maintain scalable data pipelines for high-volume IoT data ingestion, streaming platforms, and similar technologies.
• Work closely with the data science team to support real-time data processing and model training workflows on platforms such as Databricks.
• Optimise TimescaleDB databases for managing large-scale, terabyte-sized time-series data.
• Ensure smooth integration of IoT telemetry with the data platform.
• Manage cloud infrastructure on Azure, using Infrastructure as Code tools and deploying with Docker for scalability.
• Monitor and optimise data pipelines to enhance performance, reduce costs, improve scalability, and ensure reliability.
• Implement technologies to support data governance, quality control, and system monitoring.
• Document systems and processes and communicate effectively with cross-functional teams.

Key Skills:

• 5+ years of experience in data engineering, with a focus on high-volume data pipelines and real-time data processing.
• Experience working with event streaming platforms for large-scale data ingestion.
• Proficiency in managing time-series databases and handling terabyte-scale datasets, particularly with TimescaleDB.
• Hands-on experience with Python for production-level data processing and AI/ML model deployment (e.g., MLflow, Airflow, PySpark, polars).
• Experience in building APIs to expose data pipelines, models, and insights to other systems - knowledge of frameworks like FastAPI is a bonus.
• Strong understanding of cloud infrastructure services, IaC tools such as Terraform, and Docker for containerised deployments.
• Excellent communication and documentation skills to collaborate across teams.

Salary (Rate): undetermined

City: Oslo

Country: Norway

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: Senior

Industry: IT