Data Engineer - Rochester, MN,Madison, WI,Des Moines, IA,Rockford, IL, Sioux Falls, SD.
Posted Today by TechniPros, LLC
Negotiable
Undetermined
Undetermined
Remote or Rochester, Minnesota
Summary: We are looking for a Data Engineer to design and develop scalable data pipelines and modern data platform solutions that support enterprise reporting and analytics. The ideal candidate should have expertise in SQL, Python, ETL/ELT development, Delta Lake, and Medallion Architecture. This role requires a focus on delivering high-quality data solutions and collaboration with various teams to ensure data governance and reliability. The position is available for W2 employment only, with locations including Rochester, MN, and other cities in the Midwest.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines supporting enterprise data and analytics initiatives.
- Build and optimize data ingestion and transformation processes for structured and semi-structured data sources.
- Implement data cleansing, enrichment, aggregation, and data preparation processes for reporting and analytical use cases.
- Support and maintain modern data platform architectures, including Delta Lake and Medallion Architecture (Bronze, Silver, Gold).
- Ensure data quality, consistency, and reliability through validation, monitoring, and troubleshooting activities.
- Maintain and document data lineage to provide end-to-end traceability from source systems to reporting and analytics platforms.
- Collaborate with BI, Analytics, Governance, and Business teams to gather requirements and deliver trusted datasets.
- Support reporting and dashboard solutions, preferably within Power BI environments.
- Implement and maintain data security controls, including Role-Based Access Control (RBAC) and governance standards.
- Participate in platform enhancements, automation initiatives, and data engineering best practices.
Key Skills:
- Strong proficiency in SQL and Python.
- Experience designing, building, and supporting scalable data pipelines and enterprise data platforms.
- Hands-on experience with ETL/ELT development and data integration frameworks.
- Strong understanding of modern data architecture concepts:
- Delta Lake
- Medallion Architecture (Bronze, Silver, Gold Layers)
- Data transformation and preparation techniques
- Data lineage and traceability
- Data quality and governance principles
- Experience supporting reporting and analytics platforms, preferably Power BI.
- Knowledge of data security concepts and RBAC (Role-Based Access Control).
- Strong troubleshooting, debugging, and root-cause analysis skills.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Job Title: Data Engineer
Location: Rochester, MN,Madison, WI,Des Moines, IA,Rockford, IL,Sioux Falls, SD.
Can do Only W2, No C2C
Job Summary:
We are seeking a highly skilled Data Engineer to design, develop, and support scalable data pipelines and modern data platform solutions that enable enterprise reporting, analytics, and business intelligence initiatives. The ideal candidate will have strong expertise in SQL, Python, ETL/ELT development, Delta Lake, and Medallion Architecture, with a passion for delivering high-quality, well-governed, and reliable data solutions across the enterprise.
Key Responsibilities:
- Design, develop, and maintain scalable ETL/ELT pipelines supporting enterprise data and analytics initiatives.
- Build and optimize data ingestion and transformation processes for structured and semi-structured data sources.
- Implement data cleansing, enrichment, aggregation, and data preparation processes for reporting and analytical use cases.
- Support and maintain modern data platform architectures, including Delta Lake and Medallion Architecture (Bronze, Silver, Gold).
- Ensure data quality, consistency, and reliability through validation, monitoring, and troubleshooting activities.
- Maintain and document data lineage to provide end-to-end traceability from source systems to reporting and analytics platforms.
- Collaborate with BI, Analytics, Governance, and Business teams to gather requirements and deliver trusted datasets.
- Support reporting and dashboard solutions, preferably within Power BI environments.
- Implement and maintain data security controls, including Role-Based Access Control (RBAC) and governance standards.
- Participate in platform enhancements, automation initiatives, and data engineering best practices.
Required Skills:
- Strong proficiency in SQL and Python.
- Experience designing, building, and supporting scalable data pipelines and enterprise data platforms.
- Hands-on experience with ETL/ELT development and data integration frameworks.
- Strong understanding of modern data architecture concepts:
- Delta Lake
- Medallion Architecture (Bronze, Silver, Gold Layers)
- Data transformation and preparation techniques
- Data lineage and traceability
- Data quality and governance principles
- Experience supporting reporting and analytics platforms, preferably Power BI.
- Knowledge of data security concepts and RBAC (Role-Based Access Control).
- Strong troubleshooting, debugging, and root-cause analysis skills.
Preferred Qualifications:
- 3 5+ years of experience in Data Engineering or a related field.
- Experience with Microsoft Fabric.
- Familiarity with data catalog and lineage tools such as Microsoft Purview or similar platforms.
- Experience with CI/CD pipelines and DevOps practices using Azure DevOps, Git, or similar tools.
- Exposure to streaming data platforms and real-time data ingestion architectures.
- Experience working within enterprise data governance programs.
- Soft Skills
- Excellent analytical and problem-solving abilities.
- Strong communication and collaboration skills.
- Ability to work effectively in cross-functional teams.
- Detail-oriented with a focus on data quality and governance.
- Self-motivated and capable of managing multiple priorities.
Mandatory Skills:
- SQL
- Python
- ETL/ELT Development
- Data Engineering
- Delta Lake
- Medallion Architecture (Bronze, Silver, Gold)
- Data Lineage
- Data Quality & Governance
- Power BI
- RBAC (Role-Based Access Control)
- Data Integration Frameworks