Data Engineer - SQL/ETL

Data Engineer - SQL/ETL

Posted 4 days ago by Tipstat®

Apply
Negotiable
Undetermined
Undetermined
United Kingdom
Apply
Airflow Amazon Web Services (AWS) Apache Airflow Apache NiFi BigQuery Business Requirements Computer Science Data-Driven Decision-Making Data Analysis Data Architecture Database Design Data Integrity Datamodel Data Modeling Data Science Data Validation Data Warehousing Extract Transform Load (ETL) Generic Programming Machine Learning Power BI Probability And Statistics Python (Programming Language) Relational Databases Snowflake (Data Warehouse) Software Development SQL (Programming Language) Statistics Tableau (Business Intelligence Software) Verification And Validation Web SQL Databases

Summary: The Data Engineer role focuses on managing large datasets to prepare them for machine learning pipelines, conducting data analysis and visualization, and optimizing storage solutions. The position requires proficiency in SQL databases and involves designing and maintaining ETL processes while collaborating with data analysts and scientists. The engineer will ensure data integrity and performance while documenting processes and architecture. A strong analytical background and programming skills in data-centric languages are essential for success in this role.

Key Responsibilities:

  • Design, develop, and maintain robust ETL processes to effectively extract, transform, and load data from various sources into the data warehouse.
  • Collaborate with data analysts and data scientists to understand business requirements and deliver optimized data solutions to support data-driven decision-making.
  • Ensure the integrity and accuracy of data by performing regular data validation and troubleshooting any data-related issues that arise.
  • Optimize SQL queries and database performance to handle large volumes of data efficiently and improve system responsiveness.
  • Develop and maintain detailed documentation of ETL processes, data models, and data architecture to ensure clarity and continuity within the team.

Key Skills:

  • Proficiency in SQL with the ability to write efficient, optimized queries for complex datasets.
  • Strong analytical skills with experience working with large-scale data environments (e.g., data warehouses, relational databases).
  • Programming experience in Python, R, or another data-focused language.
  • Familiarity with ETL tools and frameworks (e.g., Airflow, dbt, Apache NiFi).
  • Experience with BI platforms such as Tableau, Power BI, Looker, or similar.
  • Solid understanding of data modeling, data warehousing concepts, and database design.
  • Experience working with cloud-based data platforms (e.g., AWS Redshift, Google BigQuery, Snowflake).
  • Strong problem-solving abilities and attention to detail.
  • Excellent communication skills with the ability to translate technical findings into business insights.
  • Bachelor's degree in Computer Science, Data Science, Statistics, Engineering, or a related field (or equivalent work experience).

Salary (Rate): undetermined

City: undetermined

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

We are looking for a strong Data Engineer who can work with a large amount of data and can prepare it for the ML pipelines, provide data analysis and visualization, and continuously do storage optimization tasks. Experience with a different type of SQL databases(MySQL/PostgreSQL/MSSQL), knowledge of JOINS, inner selects and index specification/creation to speed up requests.

Tasks

  • Design, develop, and maintain robust ETL processes to effectively extract, transform, and load data from various sources into the data warehouse.
  • Collaborate with data analysts and data scientists to understand business requirements and deliver optimized data solutions to support data-driven decision-making.
  • Ensure the integrity and accuracy of data by performing regular data validation and troubleshooting any data-related issues that arise.
  • Optimize SQL queries and database performance to handle large volumes of data efficiently and improve system responsiveness.
  • Develop and maintain detailed documentation of ETL processes, data models, and data architecture to ensure clarity and continuity within the team.

Requirements

  • Proficiency in SQL with the ability to write efficient, optimized queries for complex datasets.
  • Strong analytical skills with experience working with large-scale data environments (e.g., data warehouses, relational databases).
  • Programming experience in Python, R, or another data-focused language.
  • Familiarity with ETL tools and frameworks (e.g., Airflow, dbt, Apache NiFi).
  • Experience with BI platforms such as Tableau, Power BI, Looker, or similar.
  • Solid understanding of data modeling, data warehousing concepts, and database design.
  • Experience working with cloud-based data platforms (e.g., AWS Redshift, Google BigQuery, Snowflake).
  • Strong problem-solving abilities and attention to detail.
  • Excellent communication skills with the ability to translate technical findings into business insights.
  • Bachelor's degree in Computer Science, Data Science, Statistics, Engineering, or a related field (or equivalent work experience).
Apply
Similar Jobs
Loading data...