Lead Data Engineer
Posted Today by 1756882077
Negotiable
Outside
Remote
USA
Summary: The role of Senior Data Engineer at KPI involves leading data transformation projects and developing innovative data solutions using Azure Native Services. Candidates should have extensive experience in data engineering, particularly in building large-scale data systems. The position requires collaboration with cross-functional teams and mentorship of junior engineers. This is an opportunity for those passionate about solving complex engineering problems in a dynamic environment.
Key Responsibilities:
- Data Engineering: Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
- Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
- Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
- Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
- Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Key Skills:
- Minimum 8+ years of overall experience in IT Industry.
- 4+ years of experience in data engineering, with a strong background in building large-scale data solutions.
- 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions)
- Proven expertise in SQL for querying, manipulating, and analyzing large datasets.
- Strong knowledge of ETL processes and data warehousing fundamentals.
- Self-motivated and independent, with a let’s get this done mindset and the ability to thrive in a fast-paced and dynamic environment.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
About the Role:
We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team at KPI, working on challenging and multi-year data transformation projects. This is an excellent opportunity for a talented data engineer to play a key role in building innovative data solutions using Azure Native Services and related technologies. If you are passionate about working with large-scale data systems and enjoy solving complex engineering problems, this role is for you.
Key Responsibilities:
- Data Engineering : Design, development, and implementation of data pipelines and solutions using PySpark, SQL, and related technologies.
- Collaboration: Work closely with cross-functional teams to understand business requirements and translate them into robust data solutions.
- Data Warehousing: Design and implement data warehousing solutions, ensuring scalability, performance, and reliability.
- Continuous Learning: Stay up to date with modern technologies and trends in data engineering and apply them to improve our data platform.
- Mentorship: Provide guidance and mentorship to junior data engineers, ensuring best practices in coding, design, and development.
Must-Have Skills & Qualifications:
- Minimum 8+ years of overall experience in IT Industry.
- 4+ years of experience in data engineering, with a strong background in building large-scale data solutions.
- 4+ years of hands-on experience developing and implementing data pipelines using Azure stack experience (Azure, ADF, Databricks, Functions)
- Proven expertise in SQL for querying, manipulating, and analyzing large datasets.
- Strong knowledge of ETL processes and data warehousing fundamentals.
- Self-motivated and independent, with a let s get this done mindset and the ability to thrive in a fast-paced and dynamic environment.
Good-to-Have Skills:
- Databricks Certification is a plus.
- Data Modeling, Azure Architect Certification, CPG.