Azure Data Engineer

Azure Data Engineer

Posted Today by 1773902826

Negotiable
Undetermined
Hybrid
Location Barcelona, Catalonia, Spain

Summary: The role of Azure Data Engineer involves designing and delivering reliable data solutions that enhance business processes through effective data management. The position requires expertise in building scalable data pipelines and automating workflows, with a strong focus on collaboration and adherence to security guidelines. The engineer will work with various stakeholders to ensure timely data delivery and foster a data-driven culture within the organization. This role offers a hybrid working model and opportunities for career development.

Key Responsibilities:

  • Create and build data ingestion pipelines using Azure Synapse Pipelines, Azure Functions, and Synapse Notebooks
  • Develop script in Python or PySpark for automation
  • Extract data from diverse sources including APIs, databases, flat files, and other cloud or on-premise systems
  • Maintain and optimize Synapse Dedicated SQL Pools for data storage and analytical queries
  • Manage code using Git for source control and CI/CD, ensuring consistent and governed deployment of pipelines and artifacts across environments
  • Automate failure handling, alerts, and retries to minimize operational overhead
  • Collaborate with different stakeholders to ensure that data meets business needs and is delivered on time
  • Provide technical troubleshooting, issue resolution, and continuous support for data delivery pipelines
  • Ensure adherence to security, privacy, and development guidelines
  • Document processes and data flows for transparency and knowledge sharing
  • Identify opportunities for standardisation and automate data maintenance processes
  • Foster a data-driven culture and advocate for the benefits of data management
  • Engage with leadership and functional leads to ensure alignment and support

Key Skills:

  • 5+ years of experience in Azure Synapse Analytics (pipelines, notebooks, SQL pools)
  • Azure Data Lake Storage Gen2 (architecture, management, security)
  • Python & PySpark (data processing, automation)
  • T-SQL (complex queries, procedures)
  • Development of ETL/ELT workflows using modern orchestration tools
  • RESTful API design & integration
  • Experience with Databricks is nice to have
  • Azure Functions & Logic Apps (event-driven/serverless)
  • Security: Azure RBAC, Managed Identities, Key Vault
  • Monitoring & alerting (Azure Monitor, Log Analytics)
  • Familiarity with ServiceNow APIs is an added advantage
  • Experience in CI/CD and GitHub Actions is a plus
  • PowerShell, YAML Azure CLI is a plus

Salary (Rate): undetermined

City: Barcelona

Country: Spain

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

About the Job

We are looking for a dynamic Data Engineer to play a pivotal role in our data journey by providing hands-on support to design and deliver reliable data solutions that support business critical processes that harness the full value of its robust and dynamic data landscape.

If you are passionate about building scalable pipelines, automating workflows, and making data accessible and impactful, then role is for you.

What you do

  • Create and build data ingestion pipelines using Azure Synapse Pipelines, Azure Functions, and Synapse Notebooks
  • Develop script in Python or PySpark for automation
  • Extract data from diverse sources including APIs, databases, flat files, and other cloud or on-premise systems.
  • Maintain and optimize Synapse Dedicated SQL Pools for data storage and analytical queries.
  • Manage code using Git for source control and CI/CD, ensuring consistent and governed deployment of pipelines and artifacts across environments.
  • Automate failure handling, alerts, and retries to minimize operational overhead
  • Collaborate with different stakeholders to ensure that data meets business needs and is delivered on time.
  • Provide technical troubleshooting, issue resolution, and continuous support for data delivery pipelines.
  • Ensure adherence to security, privacy, and development guidelines.
  • Document processes and data flows for transparency and knowledge sharing.
  • Identify opportunities for standardisation and automate data maintenance processes.
  • Foster a data-driven culture and advocate for the benefits of data management.
  • Engage with leadership and functional leads to ensure alignment and support.

What you bring

  • 5+ years of experience in Azure Synapse Analytics (pipelines, notebooks, SQL pools)
  • Azure Data Lake Storage Gen2 (architecture, management, security)
  • Python & PySpark (data processing, automation)
  • T-SQL (complex queries, procedures)
  • Development of ETL/ELT workflows using modern orchestration tools
  • RESTful API design & integration
  • Experience with Databricks is nice to have
  • Azure Functions & Logic Apps (event-driven/serverless)
  • Security: Azure RBAC, Managed Identities, Key Vault
  • Monitoring & alerting (Azure Monitor, Log Analytics)
  • Familiarity with ServiceNow APIs is an added advantage
  • Experience in CI/CD and GitHub Actions is a plus
  • PowerShell, YAML Azure CLI is a plus

What we offer

  • We offer a hybrid work model which recognises the value of striking a balance between in-person collaboration and remote working incl. up to 25 days per year working from abroad.
  • We believe in rewarding performance and our compensation and benefits package includes a company bonus scheme, pension, employee shares program and multiple employee discounts (details vary by location).
  • From career development and digital learning programs to international career mobility, we offer lifelong learning for our employees worldwide and an environment where innovation, delivery and empowerment are fostered.
  • Flexible working, health and well being offers (including healthcare and parental leave benefits) support to balance family and career and help our people return from career breaks with experience that nothing else can teach.

Conditions

  • Location: Hybrid + 2 day onsite/week
  • Duration: 8months + strong possibilities of internalisation
  • Start Date: ASAP
  • Contract Type: Freelance (via Huxley)

If you're open to it, apply with your updated resume and we will you contact you as soon as possible.

Let op: vacaturefraude

Helaas komt vacaturefraude steeds vaker voor. We waarschuwen je voor mogelijke misleiding:

  • Wij zullen nooit via WhatsApp of in een videogesprek vragen om jouw persoonlijke gegevens (zoals een kopie van je ID, bankgegevens of BSN).
  • Twijfel je over de echtheid van een vacature of contactpersoon? Neem dan altijd rechtstreeks contact met ons op via de officiële contactgegevens op onze website.

Important: job fraud

Unfortunately, job fraud is becoming more common. Beware of such scams:

  • We will never ask for personal information (such as a copy of your ID, bank details, or social security number) via WhatsApp or during a video call.
  • If you're unsure whether a vacancy or contact person is legitimate, please reach out to us directly using the official contact details on our website.