Position Overview
The Commonwealth of Pennsylvania is seeking a Data Engineer & Insights Analyst to transform complex data into actionable insights for the Pennsylvania Longitudinal Data System (PALDS). This role involves building cloud data pipelines, integrating multi-source datasets, ensuring data quality, and creating analytics tools to support government decision-making.
Key Details
- Work Arrangement: Remote
- Location: Harrisburg, PA
- Interview Process: Round 1 (Teams / Virtual) | Round 2 (In-person in Harrisburg for finalists)
AWS Cloud Services
- S3, Glue, EMR, Redshift, Athena, Lambda
Big Data & Pipelines
- Apache Airflow, Spark, Kafka, Hadoop
Scripting Languages
- Python, R, Java, Scala
Databases & SQL
- Advanced SQL, Oracle, Postgres, MS SQL Server, NoSQL (Cassandra)
Data Modeling
- Dimensional modeling, Data Vault, Star/Snowflake schemas
Data Integration & Quality
- ETL/ELT, Data Lineage, Data Governance, Metadata Management
Analytics & Visualization
- Dashboards, analytical models, decision-support tools
DevOps & APIs
- Git, CI/CD pipelines, REST APIs