Sr. Data Engineers Lead

Sr. Data Engineers Lead

Posted Today by 1756880708

Negotiable
Outside
Remote
USA

Summary: The role of Senior Data Engineering Lead requires a highly experienced professional with over 10 years in data engineering, data warehousing, and data lake technologies, specifically on the Azure cloud platform. The candidate will lead development efforts, manage stakeholders, and possess strong technical and leadership skills. Expertise in programming, data warehousing best practices, and cloud data engineering concepts is essential for success in this position. The role is remote and classified as outside IR35.

Key Responsibilities:

  • Manage stakeholders and lead development efforts in data engineering projects.
  • Design and implement data warehousing and data lake solutions on Azure.
  • Utilize programming skills in Python, PySpark, and SQL for data processing.
  • Ensure adherence to data warehouse best practices and development standards.
  • Drive project timelines and ensure high-quality deliverables from development teams.
  • Implement Medallion Architecture for data management.
  • Utilize ETL/ELT tools for data integration and management.
  • Oversee data management and storage solutions using Azure services.
  • Provide analytical and problem-solving support for data-related challenges.

Key Skills:

  • 10+ years of experience in data engineering and data warehousing.
  • Proficient in Python, PySpark, and SQL.
  • Expertise in Microsoft Azure Cloud Services.
  • Experience with Azure Synapse, Azure SQL, Amazon Redshift, Snowflake, or Google Big Query.
  • Strong data modeling skills with a minimum of 12 years in SQL and dimensional data modeling.
  • Experience with Databricks and other big data tools.
  • Familiarity with ETL/ELT tools such as ADF, Informatica, and Talend.
  • Proficiency with Azure SQL Database, Azure Data Lake Storage, and Azure Blob Storage.
  • Strong analytical and problem-solving skills.
  • Leadership experience in managing development teams.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Sr. Data Engineers Lead

Remote

Long Term

Exp: min 12+

We are seeking a highly experienced Senior Data Engineering Lead with minimum 10+ years experience in modern data engineering, data warehousing and data lake technologies on Azure cloud platform.

The successful candidate will possess a strong technical background and proven leadership skills to manage stakeholders, design, and lead development efforts.

Key Qualifications:

The candidate must have experience and expert skills in the following areas:

Programming Skills: Stellar hands-on expertise in Python, PySpark, and SQL.

Azure Expertise: Proficient in Microsoft Azure Cloud Services.

Data Warehousing: Expertise in data warehouse best practices, development standards and methodologies. Minimum of 5 years of experience in modern data engineering, data warehousing (Azure Synapse, Azure SQL, Amazon Redshift, Snowflake or Google Big Query), and data lake technologies on the Azure cloud.

Data Modeling Expertise: Minimum of 12 years of proven experience with SQL, schema design, and dimensional data modeling.

Big Data Tools: Strong experience with platforms (mandatory) such as Databricks (preferable). Experience with Databricks is highly desirable but not mandatory.

Cloud Data Engineering concepts: Experience with common ETL/ELT tools (ADF, Informatica, Talend) and implementing Medallion Architecture for data management.

Data Management and Storage: Proficiency with Azure SQL Database, Azure Data Lake Storage, Azure Cosmos DB, Azure Blob Storage, etc.

Analytical Skills: Strong analytical and problem-solving skills.

Leadership: Lead development teams, drive project timelines, and ensure high-quality deliverables.

Additional Preferred Qualifications:

- Azure DevOps and CI/CD deployments

- Cloud migration methodologies and processes

- 2+ yrs of experience with Power BI

- 5+ yrs of experience with any reporting/visualization tool like Tableau/OBIEE etc.

Torque Technologies LLC is an Equal Opportunity Employer (EOE). Qualified applicants are considered for employment without regard to age, race, color, religion, sex, national origin, sexual orientation, disability, or veteran status.