Over 8 Years of experience in IT.
- Design and implement end-to-end lifecycle of Databricks platform on AWS.
- Good experience in working with Healthcare insurance clients.
- Design and implement different environments like Dev/SIT/UAT/PROD for Databricks.
- Expertise in AWS
- Implement data access controls, Lineage and auditing using Unity catalog.
- Implement CI/CD pipelines between different environments.
- Hands-on architecture experience within AWS, Azure, or Google Cloud Platform environments.
- Deep expertise in Apache Spark, Delta Lake, SQL, and cluster resource management.
- Translate business requirements into technical blueprints, run proof-of-concepts (POCs), and guide engineering teams on best practices
- AI/ML Enablement, experience in setting up AI and Genie for Databricks.
- Experience with Delta lake house, Unity catalog, DBX notebooks, Python, Pyspark, Genie, Databricks Apps.
Rate:
Not specified
Location:
Remote
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
Data & Analytics
Seniority Level:
Senior