Responsibilities
- Create and maintain optimal data pipeline architecture.
- Design and implement cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
- Build and maintain data orchestration workflows using tools such as Apache Airflow, AWS Step Functions, or similar services.
- Assemble large, complex data sets that meet functional / non-functional business area requirements.
- Engineer analytical data environments that support advanced statistical analysis, predictive modeling, machine learning, and evidence-building activities.
- Partner with data scientists, research analysts, and policy analysts to ensure enterprise data assets support reproducible research and statistical modeling.
- Identify, design, and implement internal process improvements: e.g. automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
Rate:
Not specified
Location:
Remote
IR35 Status:
Outside
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Not Specified