Data Engineer

Summary: We are seeking a highly skilled Data Engineer to join our Customer's team, focusing on designing and developing data management pipelines using Python, Azure, and Databricks. The role emphasizes enhancing performance, ensuring data quality, and optimizing transformation queries. This position offers the opportunity to work remotely within a team that values innovation and efficiency.

Key Responsibilities:

• Design and develop scalable data management pipelines and reusable components.
• Configure and optimize data pipelines using Azure and Databricks.
• Ensure high data quality and performance through meticulous testing and validation.
• Collaborate with cross-functional teams to integrate and onboard data effectively.
• Utilize CI/CD practices for efficient deployment and maintenance of data solutions.
• Troubleshoot and resolve issues related to data integration and resource management.
• Contribute to the continuous improvement of data analytics processes and methodologies.

Key Skills:

• Proven experience with Python development in data engineering contexts.
• Strong expertise in Azure functions and integration with source systems.
• Hands-on experience with Databricks for data processing and analytics.
• Proficiency in Azure DevOps and CI/CD methodologies.
• Excellent written and verbal communication skills, with a keen attention to detail.
• Data management and data integration experience, focusing on performance and quality.
• Ability to analyze and optimize data transformation and enrichment queries.

Salary (Rate): undetermined

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT