Lead Data Engineer / Architect ONLY VISA INDEPENDENT VISA''S
Posted Today by Cleo Consulting Inc.
Negotiable
Undetermined
Remote
Remote
Summary: The role of Lead Data Engineer / Architect involves designing and scaling enterprise Lakehouse architecture on Databricks, driving data platform standards, and mentoring engineering teams. Candidates should possess extensive experience in data engineering, particularly with Databricks and Spark. The position offers flexibility with remote, onsite, or hybrid working arrangements. This is a 12-month contract requiring a high level of expertise in data architecture and engineering practices.
Key Responsibilities:
- Architecture & Scaling: Design, build, and scale production-grade enterprise Lakehouse architectures on Databricks.
- Data Modeling: Implement robust data modeling strategies across cloud platforms using the Medallion Architecture (Bronze, Silver, Gold).
- Leadership & Standards: Drive data platform engineering standards, make critical technical decisions, and mentor engineering teams.
- Optimization: Manage and execute end-to-end performance tuning and cost optimization strategies in Spark and Databricks environments.
Key Skills:
- Databricks & Spark: Deep expertise in Databricks, Apache Spark (PySpark / Scala), and Delta Lake.
- Data Pipelines: Proven track record building large-scale data processing workflows and enterprise data pipelines.
- Cloud Infrastructure: Strong hands-on experience with major cloud platforms (Azure, AWS, or Google Cloud Platform).
- Advanced SQL: Exceptional SQL capability for processing complex, massive-scale data structures.
Salary (Rate): undetermined
City: undetermined
Country: undetermined
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Description
- We are seeking a high-caliber Lead Data Engineer / Architect to take ownership of designing and scaling our enterprise Lakehouse architecture on Databricks. In this role, you will drive data platform standards, lead engineering decisions, optimize performance/costs, and mentor engineering teams.
Key Responsibilities:
- Architecture & Scaling: Design, build, and scale production-grade enterprise Lakehouse architectures on Databricks.
- Data Modeling: Implement robust data modeling strategies across cloud platforms using the Medallion Architecture (Bronze, Silver, Gold).
- Leadership & Standards: Drive data platform engineering standards, make critical technical decisions, and mentor engineering teams.
- Optimization: Manage and execute end-to-end performance tuning and cost optimization strategies in Spark and Databricks environments.
Core Skills Required:
- Databricks & Spark: Deep expertise in Databricks, Apache Spark (PySpark / Scala), and Delta Lake.
- Data Pipelines: Proven track record building large-scale data processing workflows and enterprise data pipelines.
- Cloud Infrastructure: Strong hands-on experience with major cloud platforms (Azure, AWS, or Google Cloud Platform).
- Advanced SQL: Exceptional SQL capability for processing complex, massive-scale data structures.
How to Apply:
- If you meet the 14+ years experience criteria and have deep Databricks expertise, please shoot your updated resume directly to:
“Cleo Consulting is an equal opportunity employer (Minorities/Women/Veterans/Disabled)”