Data Analyst

Data Analyst

Posted 2 weeks ago by NLB Services

Apply
Negotiable
Inside
Undetermined
Glasgow, Scotland, United Kingdom
Apply
Agile Methodology Amazon Web Services (AWS) Apache Spark Azure Databricks Business Requirements Cloud Computing Cloud Technology Continuous Integration and Continuous Delivery Data Analysis Databricks Data Engineering Data Integration Data Lakes Datamodel Data Modeling Data Pipeline Data Validation Data Warehousing Log Files Logical Systems Microsoft Azure NoSQL NumPy Pandas (Python Package) Performance Tuning Pyspark Python (Programming Language) Scalability Security Clearance Snowflake (Data Warehouse) Software Coding Software Engineering SQL (Programming Language) Supervision Thought Leadership Unstructured Data User Acceptance Testing (UAT) Verification And Validation

Summary: The Data Engineer role is a contract position based in Glasgow, UK, requiring expertise in designing and implementing data solutions across various technical stacks. The role involves collaborating on data pipelines, providing thought leadership on technology choices, and ensuring efficient data integration and performance. Candidates should have a strong background in Python, SQL, and experience in both on-prem and cloud environments. The position emphasizes Agile practices and the development of comprehensive documentation for data solutions.

Key Responsibilities:

  • Design and implement tailored data solutions to meet customer needs and use cases.
  • Provide thought leadership by recommending appropriate technologies and solutions.
  • Demonstrate proficiency in coding skills using Python & SQL for production solutions.
  • Collaborate across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS.
  • Develop components in Python for a unified data pipeline framework.
  • Establish best practices for data usage across on-prem and cloud platforms.
  • Assist with testing and deployment of the data pipeline framework.
  • Monitor performance of queries and data loads, performing tuning as necessary.
  • Provide assistance during QA & UAT phases to confirm issues and determine resolutions.
  • Develop SQL-based data validation, reporting, and analysis as required.
  • Generate comprehensive solution documentation, including diagrams and logical views.
  • Adhere to Agile practices throughout the solution development process.
  • Design, build, and deploy databases and data stores to support organizational requirements.

Key Skills:

  • 4+ years of experience in Software Engineering, Data Engineering, or Data Analytics projects.
  • 4+ years of experience in data development in complex data environments.
  • 3+ years of SQL / PLSQL experience for data analysis.
  • 3+ years of experience developing data pipelines and warehousing solutions using Python.
  • 2+ years of experience in hybrid data environments (on-Prem and Cloud).
  • Hands-on experience with developing data pipelines for various data types.
  • Experience with performance tuning SQL queries and Spark jobs.
  • Understanding of E-R data models (conceptual, logical, and physical).
  • Strong analytical skills to interpret business requirements into technical solutions.
  • Strong verbal and written communication skills.
  • Ability to collaborate effectively across IT and Business groups.
  • Self-starter with proven ability to manage multiple projects.
  • Strong problem-solving skills and ability to clarify business objectives.

Salary (Rate): undetermined

City: Glasgow

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: inside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role: Data Engineer

Type: Contract(Inside Ir35)

Location: Glasgow, UK(3 days/week)

Key Responsibilities:

  • Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.
  • Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer to infrastructure.
  • Demonstrate proficiency in coding skills, utilizing languages Python & SQL, to efficiently move solutions into production while prioritizing performance, security, scalability, and robust data integrations.
  • Collaborate seamlessly across diverse technical stacks, including Cloudera, Databricks, Snowflake, Azure, AWS, etc.
  • Develop various components in Python of our unified data pipeline framework.
  • Contribute towards the establishment of best practices for the optimal and efficient usage of data across various on-prem and cloud platforms.
  • Assist with the testing and deployment of our data pipeline framework utilizing standard testing frameworks and CI/CD tooling.
  • Monitor the performance of queries and data loads and perform tuning as necessary.
  • Provide assistance and guidance during the QA & UAT phases to quickly confirm the validity of potential issues and to determine the root cause and best resolution of verified issues.
  • Develop SQL-based data validation, reporting, analysis, etc. as required
  • Generate comprehensive solution documentation, including sequence diagrams, class hierarchies, logical system views, etc.
  • Adhere to Agile practices throughout the solution development process.
  • Design, build, and deploy databases and data stores to support organizational requirements.

Skills / Qualifications:

  • 4+ years of experience supporting Software Engineering, Data Engineering, or Data Analytics projects.
  • 4+ years of experience in data development and solutions in highly complex data environments with large data volumes.
  • 3+ years of SQL / PLSQL experience with the ability to write ad-hoc and complex queries to perform data analysis.
  • 3+ years of experience developing data pipelines and data warehousing solutions using Python and libraries such as Pandas, NumPy, PySpark, etc.
  • 2+ years of experience developing solutions in a hybrid data environment (on-Prem and Cloud)
  • Hands on experience with developing data pipelines for structured, semi-structured, and unstructured data and experience integrating with their supporting stores (e.g. RDBMS, NoSQL DBs, Document DBs, Log Files, etc.)
  • Experience with performance tuning SQL queries, Spark job, and stored procedures.
  • An understanding of E-R data models (conceptual, logical, and physical).
  • Strong analytical skills, including a thorough understanding of how to interpret customer business requirements and translate them into technical designs and solutions.
  • Strong communication skills both verbal and written.
  • Capable of collaborating effectively across a variety of IT and Business groups, across regions, roles and able to interact effectively with all levels.
  • Self-starter.
  • Proven ability to manage multiple, concurrent projects with minimal supervision.
  • Can manage a complex ever changing priority list and resolve conflicts to competing priorities.
  • Strong problem-solving skills.
  • Ability to identify where focus is needed and bring clarity to business objectives, requirements, and priorities.

Preferred Qualifications

  • Experience in financial services
Apply
Similar Jobs
Loading data...