Logical DBA, MySQL - Data Engineer
Posted 1 day ago by ST Global Tech LLC
Negotiable
Inside
Remote
London Area, United Kingdom
Summary: A strong Data Engineer is needed for a long-term contract role focused on Data Transformation within the Client's Digital Screening. The position involves building secure data ingestion and transformation pipelines, implementing data cleansing rules, and producing auditable outputs. The role requires advanced SQL knowledge and scripting skills in Python, along with experience in handling geospatial data and modern data tooling. UK citizenship is mandatory for this position.
Key Responsibilities:
- Establish import/export patterns, handling data extracts, schema discovery, and incremental loads.
- Develop data transformation-heavy pipelines from data profiling to cleansing, standardization, conformance, and publishing.
- Utilize advanced SQL for profiling, joins/merges, deduplication, anomaly detection, and performance tuning.
- Implement automation and data quality checks using Python scripting, including data wrangling and visualization packages.
- Work with modern data tooling such as Spark and Azure Data Factory.
- Handle geospatial data, including spatial formats and analysis workflows.
- Interpret geographical context in data processing pipelines and aggregate geospatial insights into broader datasets.
- Build rules for completeness, validity, and consistency, and implement exception handling.
Key Skills:
- Advanced SQL knowledge.
- Proficiency in Python scripting and relevant packages (e.g., Pandas, scikit-learn, matplotlib).
- Experience with data transformation and cleansing processes.
- Familiarity with modern data tooling (e.g., Spark, Azure Data Factory).
- Experience with geospatial data and analysis.
- Ability to work with publicly available datasets, particularly ONS data products.
- Strong problem-solving skills and ability to write maintainable code.
Salary (Rate): 200 GBP/Day
City: London
Country: United Kingdom
Working Arrangements: remote
IR35 Status: inside IR35
Seniority Level: undetermined
Industry: IT
A strong Data Engineer is required to work on the Data Transformation workstream within Client`s Digital Screening. The core focus of this role is to build secure, repeatable data ingestion and transformation pipelines, to implement data cleansing rules, and to produce auditable, reproducible outputs.
- Establish Import/export patterns, handling data extracts, schema discovery, incremental loads, handling multiple source instances
- Capability in data transformation-heavy pipelines from data-profiling to cleansing to standardization, conformance and publishing
- Advanced knowledge of SQL for profiling, joins/merges, deduplication, anomaly detection, and performance tuning
- Scripting knowledge in Python for automation, parsing, rules engines, and data quality checks, ability to write maintainable code. Experience using Python packages for data wrangling (e.g. Pandas, Polars), modelling (e.g. scikit-learn) and visualization (e.g. matplotlib)
- Experience with modern data tooling (for example, Spark, Azure Data Factory) or ability to implement equivalents with code.
- Proven experience working with geospatial data, including handling spatial formats (e.g., vector, raster, GeoJSON, shapefiles), coordinate reference systems, and spatial analysis workflows
- Strong ability to interpret and apply geographical context in data processing pipelines, with demonstrated capability to aggregate, upscale, or translate local/regional geospatial insights into broader national or regional-level datasets and analytical outputs
- Experience working with publicly available official datasets, particularly Office for National Statistics (ONS) open data products (e.g.,census boundaries, geographic lookups, deprivation indices, or mid-year population estimates)
- Able to build rules for completeness/validity/consistency, implement exception handling