Summary: As a Data Engineer specializing in Python and Azure, you will be responsible for managing LCCC's data ecosystems, collaborating with various stakeholders to optimize the data platform. Your role involves building ETL/ELT pipelines, ensuring data integrity, and enhancing data quality for internal forecasting models. You will also contribute to establishing a data culture and governance within the organization.

Key Responsibilities:

• Build and maintain ETL/ELT pipelines to make data accurate and easy to use
• Ingest and transform data sets from various sources including APIs, web scraping, and third-party services
• Analyze data to identify patterns and anomalies in preparation for ETL processes
• Ensure efficient data synchronization and flow between platforms and systems
• Enhance data quality and reliability
• Establish a data culture across the organization
• Drive better data governance through principles and processes
• Set service level indicators and monitor execution of data workflows
• Identify data quality issues through profiling and stakeholder engagement

Key Skills:

• At least 1 year of data engineering experience
• Hands-on experience within the Azure Data ecosystem, including Azure Databricks, Data Factory, Data Lake, and Synapse
• Strong competence in Python, ideally with PySpark experience
• Strong competence in SQL
• Experience building and maintaining data pipelines
• Experience managing DevOps Pipelines
• Strong experience in process optimization, performance tuning, and data modeling

Salary (Rate): 60000

City: Leeds

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: Mid-Level

Industry: IT