-ltd.jpg)
Data Engineer (Python, Databricks, Snowflake, ETL)
Posted 2 days ago by Insight International (UK) Ltd
Negotiable
Undetermined
Onsite
Glasgow, Scotland, United Kingdom
Summary: The Data Engineer role focuses on developing data pipelines and data warehousing solutions using Python, Databricks, and Snowflake. The position requires a strong background in ETL principles and experience in complex data environments. The role is contract-based and involves on-site work in Glasgow three days a week. Candidates should possess excellent analytical and communication skills to collaborate effectively across various teams.
Key Responsibilities:
- Develop data pipelines and data warehousing solutions using Python and relevant libraries.
- Utilize cloud services, particularly Databricks, for building and managing scalable data pipelines.
- Work with Snowflake or similar cloud-based data warehousing solutions.
- Implement ETL principles and data integration best practices.
- Collaborate in a fast-paced, agile environment.
- Manage multiple concurrent projects with minimal supervision.
- Translate customer business requirements into technical designs and solutions.
- Utilize code versioning tools and data orchestration tools.
- Engage with data visualization tools and libraries.
- Provide strong problem-solving skills to manage changing priorities.
Key Skills:
- 4+ years of experience in data pipeline and data warehousing development using Python.
- 3+ years of hands-on experience with Databricks and cloud services.
- Proficiency in Snowflake or similar data warehousing solutions.
- Solid understanding of ETL principles and data modeling.
- Familiarity with agile methodologies and collaborative work.
- Experience with code versioning tools (e.g., Git).
- Knowledge of Linux operating systems.
- Familiarity with REST APIs and integration techniques.
- Experience with data visualization tools (e.g., Power BI).
- Background in database administration or performance tuning.
- Exposure to big data technologies (e.g., Hadoop, Spark).
- Strong analytical and communication skills.
- Self-starter with strong problem-solving abilities.
Salary (Rate): undetermined
City: Glasgow
Country: United Kingdom
Working Arrangements: on-site
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Role: Data Engineer (Python, Databricks, Snowflake, ETL) Location: Glasgow, UK (3days/week On-Site) Job Type: Contract
Skills / Qualifications: 4+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc. 3+ years hands-on experience with cloud services, especially Databricks, for building and managing scalable data pipelines 3+ years of proficiency in working with Snowflake or similar cloud-based data warehousing solutions 3+ years of experience in data development and solutions in highly complex data environments with large data volumes. Solid understanding of ETL principles, data modelling, data warehousing concepts, and data integration best practices-Familiarity with agile methodologies and the ability to work collaboratively in a fast-paced, dynamic environment. Experience with code versioning tools (e.g., Git) Knowledge of Linux operating systems Familiarity with REST APIs and integration techniques Familiarity with data visualization tools and libraries (e.g., Power BI) Background in database administration or performance tuning Familiarity with data orchestration tools, such as Apache Airflow Previous exposure to big data technologies (e.g., Hadoop, Spark) for large data processing Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions. Strong communication skills both verbal and written. Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels. Self-starter. Proven ability to manage multiple, concurrent projects with minimal supervision. Can manage a complex ever changing priority list and resolve conflicts to competing priorities. Strong problem-solving skills. Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.