Senior Data Engineer

Senior Data Engineer

Posted 2 weeks ago by Mobysoft

Negotiable
Undetermined
Hybrid
Manchester, England, United Kingdom

Summary: The Senior Data Engineer role at Mobysoft involves developing data products that enhance the social housing sector through innovative data engineering practices. The position requires collaboration with a dynamic team to ensure reliable and efficient data solutions, leveraging technologies such as AWS and MLOps. Candidates should possess strong technical skills and a proactive mindset to drive improvements and support client data journeys. The role offers competitive remuneration and a supportive work environment focused on professional development.

Key Responsibilities:

  • Ingesting and understanding new data sources and evolving the data approach.
  • Implementing and streamlining MLOps processes.
  • Exploring the use of AI for data quality monitoring and service optimization.
  • Liaising with clients to support their data-driven journeys.

Key Skills:

  • Honours degree in Information Systems, Computer Science, or related field.
  • AWS Certified Data Engineer, Associate certification.
  • 4-5+ years of experience in AWS Cloud environments.
  • Strong data reliability, governance, and security credentials.
  • Proficiency in ETL/ELT, data transformation, and data modelling.
  • Experience with Amazon Redshift, dbt, Apache Airflow, and AWS Lambda.
  • Strong programming skills in Python and SQL.
  • Knowledge of CI/CD for data pipelines and infrastructure as code.
  • Ability to work with various data formats and develop APIs.
  • Understanding of cloud security frameworks.

Salary (Rate): undetermined

City: Manchester

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Senior Data Engineer

Location: Manchester (Hybrid)

Salary: Competitive plus excellent benefits

Start: ASAP

Ideal skills: Data Engineer, MLOps, AI, Smart Data, AWS Certified, Data Governance, Data Transformation, Data Modelling

Who We Are

Founded in 2003, Mobysoft provides data-based insight solutions to a wide range of social housing clients, supplying technology to help landlords to improve their income-collection processes for the good of all involved. Mobysoft delivers two market-leading products, which help keep tenants housed in a home they can enjoy and simultaneously improves rent collection for the long term good of the organisation. Our vision is working towards a world in which intelligent technology significantly improves the quality of life for people who live in social housing and our mission is delivering accurate actionable data insights that help social housing providers to deliver a more consistent and equitable service

What are we looking for?

We are an ambitious, customer-centric Data & Insights team, dedicated to developing a new generation of data products that unlock significant value for the social housing sector. We operate with a focused product lens, driven by curiosity and a commitment to technical excellence. Data Engineering is foundational to this mission, ensuring synchronized, curated, trusted, dynamic data is available at speed and scale for our clients, data analysts, data scientists, and stakeholders. As such we are looking for a most excellent Senior Data Engineer (SDE) professional to join our dynamic team, working with our most excellent existing Senior Data Engineer, to help us deliver.

Key Responsibilities

  • Ingesting and understanding new data sources, evolving our data approach (e.g., to a fully-fledged data fabric), implementing and streamline MLOps processes and exploring how we can sensibly and safely utilise artificial intelligence (AI) to turbo charge our work (e.g., smart data quality monitoring, meta data curation and service optimisation).
  • In short there will be plenty to keep you interested, your technical and power skills developing and a real chance to drive innovation and change.
  • As part of this you may also be asked to liaise with our clients (directly or through events, conferences, webinars etc.), to help support their data driven journeys.

Why should you consider this role?

Alongside the work opportunities as described your development will be supported, you will be sensibly renumerated, we will provide a compelling benefits package, and we are a great bunch of folks to work with - though we would say that!

Qualifications And Skills Required

  • An honours degree in Information Systems, Computer Science, Information Technology, Software Engineering or similarly related and quantitative discipline.
  • AWS certification - AWS Certified Data Engineer, Associate certification.
  • 4-5+ years of commercial experience working primarily in an AWS Cloud environment using approaches/tooling like ours (see technical skills), delivering scalable, performant, reliable solutions.
  • Strong data reliability/observability, data governance and information security credentials.

What technical skills are required?

  • ETL/ELT & Data Transformation
  • Amazon Redshift (query tuning, distribution/sort keys, workload management)
  • Data modelling (normalisation, dimensional)
  • dbt (modeling, testing, documentation, deployment)
  • Building scalable ETL/ELT pipelines with Python
  • Workflow Orchestration
  • Apache Airflow (DAG design, scheduling, monitoring, scaling)
  • Best practices for dependency management, retries, and alerting
  • Cloud & Serverless
  • AWS Lambda (Python-based serverless pipelines, event-driven processing)
  • IAM roles, policies, and security best practices
  • Programming & Scripting
  • Python (data processing, automation, testing)
  • SQL (advanced query writing and optimization)
  • Data Engineering Best Practices
  • CI/CD for data pipelines (Git, GitHub Actions, etc.)
  • Data quality checks, monitoring, and observability
  • Infrastructure as Code (Terraform etc.)
  • Other Tools & Ecosystem
  • Experience with logging/monitoring
  • Exposure to data governance, cataloguing, and lineage tools
  • Ability to work with a range of structured, semi-structured and unstructured file formats including Parquet, json, csv, xml, pdf, jpg.
  • Tools and methods to develop comprehensive data reliability and active metadata solutions.
  • Ability to work with and develop APIs (including data transformations).
  • Ability to deliver data deidentification and anonymisation solutions.
  • Understanding of Cloud security frameworks (specifically on the AWS Cloud) including appropriate data encryption

Desirable

  • Utilising AI within data engineering to drive performance
  • Facilitating search tools such as Solr
  • MLOps experience including familiarity with tools such as DVC & mlflow
  • Full data engineering cycle knowledge (tools and skills) for stream data

The Person

You Are Someone Who

  • Takes ownership and thrives on improving how things are done
  • Is proactive, self-motivated, and solutions-focused
  • Can influence and collaborate across teams
  • Balances delivery detail with big-picture thinking
  • Enjoys mentoring and helping others grow
  • Is excited to help scale a values-led SaaS company making a real difference

What else are we looking for?

  • Ability to work effectively both as an individual (e.g., during remote deep work) and within a team - supportive, collaborative.
  • An individual who takes a keen interest in data engineering's frontiers and best practice.
  • Someone who is a critical thinker and a problem solver.
  • A proactive, detail focused, person who is curious and seeks continuous improvement both in our systems and their skills.
  • Clear written and verbal communication, including effective communication with non-technical audiences.
  • Business acumen, i.e., understanding the business context with a proven ability to align and actively support business goals and OKRs.
  • An individual who takes a keen interest in productivity, working to optimise their own output as part of a team that values this highly

MobyIdeals

You will behave in accordance with the MobyIdeals:

  • Customer-focused: We drive outcomes that create value for the customer. We continually challenge ourselves on whats in it for the customer. We drive win/win/win solutions.
  • Collaborative: We operate as one, fostering open communication, diverse contribution, cooperation and trust. We inspire teams towards a common goal for success.
  • Outcome-orientated; We are driven by the end goal, rather than the process or steps to get there.
  • Accountable: We own decisions, are transparent, set clear expectations and consistently deliver on commitments
  • Courageous: We actively contribute and constructively challenge with positive intent. We think big and move at pace.
  • Innovative: We own and proactively search for solutions. We positively embrace problems and lead change.

Benefits

Competitive salary and rewards package including:

  • Private Health care
  • 4 x salary Life cover
  • 25 days annual leave, increasing to 28 after 3 years service
  • salary sacrifice pension scheme and much more ..

Inclusion

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, colour, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process-please contact us to request accommodation.

If you are interested and would like to know more then please apply to with your CV highlighting your suitability or via our careers page. Please note that we are not working with any external Agencies for this position.

LNKD1_UKTJ