Senior Azure Data Developer - Remote

Senior Azure Data Developer - Remote

£600 per day (Outside IR35)/6 months rolling - Mainly remote, site visits limited to once or twice per month, Berkshire

A specialist automotive technology and research company seek a Senior Azure Data Developer to be responsible for:

• Designing, developing, and maintaining high-quality data solutions on the Microsoft Azure platform.
• This role focuses on data engineering activities, including building robust ETL/ELT pipelines, managing cloud data architectures, and ensuring that data is accessible, reliable, and well-governed for analytics and business use.
• The senior data developer will leverage Azure data services to ingest, transform, and integrate data from various sources, implement continuous integration/continuous delivery (CI/CD) deployment pipelines via Azure DevOps, and implement industry best practices in code quality, security, and compliance.
• You will also collaborate with cross-functional teams and upskill the team to drive continuous improvement in data engineering processes.

Key Accountabilities and Responsibilities for the Senior Azure Data Developer position:

• Design & Develop Data Pipelines: Build and maintain end-to-end data integration pipelines on Azure, handling data ingestion, transformation, and loading (ETL/ELT) from multiple source systems into data lakes, data warehouses, or analytics platform. Solutions should be developed with an emphasis on reusability, scalability, and maintainability, using modular design and reusable components where possible.
• Data Architecture & Modelling: Work closely with data architects to design data models and storage solutions that meet business requirements.
• Deployment & DevOps: Implement CI/CD pipelines using Azure DevOps to automate the build, testing, and deployment of data pipeline components and infrastructure.
• Code Quality & Best Practices: Enforce industry best practices in all data development work. This includes maintaining version control for all code (using Git repositories) and following coding standards.
• Data Governance & Security: Ensure all data engineering solutions comply with organizational data governance policies and security standards. Implement data security best practices such as encryption, access control, and data masking as needed.
• Monitoring & Troubleshooting: Proactively monitor data pipeline performance and data quality metrics. Use Azure monitoring tools (Azure Monitor, Log Analytics, etc.) to track pipeline runs, resource utilization, and data drift. Troubleshoot and resolve pipeline failures or data issues promptly to ensure data availability and accuracy for users.
• Mentorship: As a senior member, mentor and guide other data developers and wider technical teams. Provide technical guidance and share best practices with the team to uplift overall skill levels.
• Collaboration & Stakeholder Engagement: Work closely with cross-functional teams - including data architects, database administrators, analysts, software engineers, and business stakeholders - to gather requirements and deliver appropriate data solutions.

Knowledge, Skills, Competencies & Experience for the Senior Azure Data Developer position:

• Azure Platform Expertise: Expert knowledge of the Azure data platform and its components. Key include: Azure Data Factory (ETL orchestration), Azure Databricks/Spark (large-scale data processing), Azure Synapse Analytics or Azure SQL (analytics databases), Azure Data Lake (storage of raw and processed data), Azure Event Hubs/Stream Analytics (stream processing), and Azure Functions/Logic Apps for serverless integration tasks.
• Knowledge of relational database design, implementation, and maintenance, including MySQL, SQLServer, and PostgreSQL.
• Strong experience developing ETL, data ingestion and analytical solutions based off business requirements and architectural designs.
• Knowledge of developing data integration solutions.
• Strong applied knowledge of data modelling techniques such as Kimball, Inmon, 3NF, Data Vault.
• Performance Tuning & Optimization: Ability to optimize query performance and pipeline throughput. This may involve index tuning on SQL databases, file partitioning in data lakes, optimizing Spark jobs, or adjusting service scale to meet performance requirements.
• Data Quality & Governance: Keen focus on data quality, with experience implementing data validation, quality checks, and error handling in pipeline.
• Translation of architectural and technical requirements into robust data solutions.
• Strong communication skills to understand and deliver on business requirements.
• Passion for data and desire to learn, build and expand your skill set.
• DevOps & CI/CD: Hands-on experience with DevOps practices and tools. Candidates should have used source control (Git) for versioning code and have created or maintained CI/CD pipelines (preferably with Azure DevOps) to automate deployments of data solutions.
• Understanding of Event-driven Architectures. Including utilising Real Time technologies eg Change Data Capture and Kafka.
• Project Leadership: Demonstrated ability to take ownership of projects. Experience in breaking down tasks, providing estimates, and leading certain initiatives to completion.

Senior Azure Data Developer - Remote

£600 per day (Outside IR35)/6 months rolling - Mainly remote, site visits limited to once or twice per month, Berkshire