Data Engineer

Job Title: Azure Cloud Data Engineer

Location: Remote/WFH

Duration: 7 months+ contract

Number of Positions: 4 roles

Description

• We are looking for a contract Data Engineer for a client engagement. This Data Engineer will possess strong experience with Python and / or PySpark needed along with Azure Data Lake, ETL, ELT, and DataFlow.

Responsibilities

• Work with architects, other data engineers and analysts to identify, engage, and integrate data sources for discovery and profiling and, where necessary and define data services that empower business processes.
• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
• Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
• Partner with business analysts, application engineers, data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.

Qualifications

• 2-5 years of progressive data application development experience.
• Strong Experience with Python and / or PySpark needed.
• Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments.
• 2+ years of experience modeling and implementing ETL / ELT on columnar MPP database technologies.
• Experience with streaming architectures e.g. Kafka, Stream, PubSub.

Best Regards,

-------

David Roy | #LI-DR1 Accounts Manager – US Staffing | Charter Global Inc. |