Negotiable
Outside
Remote
USA
Summary: We are looking for a full stack engineer/developer with expertise in big data and application migration to support the transition of numerous applications to Databricks. The role involves collaborating with the Business Intelligence team to design migration strategies, developing scalable data solutions, and maintaining project documentation. The ideal candidate will possess strong problem-solving skills and the ability to manage multiple projects effectively. Experience with various programming languages and cloud technologies is essential for success in this position.
Key Responsibilities:
- Support migration of applications to Databricks, including authentication and rewiring of connections.
- Work with the Business Intelligence team to design and implement migration strategies.
- Develop scalable and reliable data solutions for real-time and batch data movement.
- Design and develop database objects, tables, stored procedures, and views.
- Independently analyze and resolve issues in real time.
- Understand Data marts and Data lakes, and migrate legacy systems accordingly.
- Utilize cloud technologies, including Azure SQL server.
- Maintain comprehensive project documentation.
- Continuously learn new technologies and improve processes.
- Communicate effectively with team members, customers, and management.
- Manage multiple projects and competing priorities.
Key Skills:
- Software development experience.
- Proficiency in programming languages such as Python, Spark, SQL, and PLSQL.
- Experience with database platforms like Oracle, SQL Server, and MySQL.
- Knowledge of big data concepts and technologies, including Synapse and Databricks.
- Familiarity with AWS and Azure cloud computing.
Salary (Rate): undetermined
City: undetermined
Country: USA
Working Arrangements: remote
IR35 Status: outside IR35
Seniority Level: undetermined
Industry: IT
The Opportunity: We are seeking a full stack engineer/developer with experience in projects emphasizing big data and application migration.
This person will be responsible for supporting our customers migration of hundreds of applications to Databricks including authentication, rewiring of connections, building new libraries, and adapting notebooks and code.
Work with the Business Intelligence team and operational stakeholders to design and implement migration strategy of read only and transaction applications to Databricks Develop scalable and reliable data solutions to move data across systems from multiple sources in real time as well as batch modes Design and develop database objects, tables, stored procedures, views, etc. as needed Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end Understands the concept of Data marts and Data lakes and experience with migrating legacy systems to data marts/lake Uses additional cloud technologies (e.g., understands concept of Cloud services like Azure SQL server) Maintain comprehensive project documentation Aptitude to learn new technologies and the ability to perform continuous research, analysis, and process improvement. Strong interpersonal and communication skills to be able to work in a team environment to include customer and contractor technical, end users, and management team members Independently analyze, solve, and correct issues in real time, providing problem resolution end-to-end Manage multiple projects, responsibilities and competing priorities.
|
Experience Needed: Software development experience Programming languages such as: Python, Spark, SQL, PLSQL Database platforms such as: Oracle, SQL Server, MySQL Big data concepts and technologies such as Synapse & Databricks AWS and Azure cloud computing |