Senior Data Tester - (Advanced SQL/Databricks/PySpark/Spark/Azure data services/Scripting/Python/Syndicates/Bordereaux/policy/claim identifiers/Insurance)

Summary: The Senior Data Tester role involves leading comprehensive data testing and validation processes within financial and operational insurance data pipelines. The position requires expertise in advanced SQL, Databricks, and PySpark, with a focus on ensuring data accuracy and integrity across various cloud data platforms. Collaboration with data engineers and stakeholders is essential to resolve defects and maintain high-quality data delivery. The role is based in London and operates in a hybrid work environment.

Key Responsibilities:

• Lead end-to-end data testing and reconciliation validation across financial and operational insurance data pipelines.
• Perform manual and exploratory data testing, including anomaly detection, variance analysis, and root cause investigation.
• Validate ETL/ELT transformations within cloud data platforms, ensuring accuracy across ingestion, transformation, and reporting layers.
• Design and execute reconciliation test strategies including control totals, completeness, accuracy, and data lineage checks.
• Develop reusable semi-automated validation scripts and regression test packs using SQL, Python, and PySpark.
• Collaborate with data engineers, product owners, and finance stakeholders to resolve defects and ensure high-quality data delivery.

Key Skills:

• Data Testing
• SQL
• Databricks
• PySpark
• Spark SQL
• Azure
• Azure Data Factory
• ADLS
• Python
• Data Reconciliation

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: hybrid

IR35 Status: undetermined

Seniority Level: undetermined

Industry: Other