Senior Software Engineer

Summary: A senior software engineer is sought to enhance large-scale data workflows through automation, data validation, and backend API development. The role focuses on creating and maintaining tools and APIs to ensure data integrity across various sources. This position emphasizes innovative data validation solutions within a collaborative, on-site environment.

Key Responsibilities:

• Develop and maintain automation tools to validate and reconcile data between API responses and database queries using PostgreSQL and Snowflake.
• Build and optimize FastAPI endpoints utilizing Pydantic BaseModel for data validation and SQLAlchemy ORM for database interaction.
• Implement API interaction and testing workflows using Python Requests and JSON libraries.
• Design and execute data validation frameworks leveraging pytest, Pandas, and other data processing tools to ensure data accuracy.
• Create real-time dashboards in Streamlit for visualizing validation results, metrics, and exception reports.
• Integrate automation workflows with Databricks and SQL pipelines for large-scale data validation and performance enhancement.
• Manage Agile development processes via Jira, including sprint planning, tracking, and issue resolution.
• Maintain code quality and version control through GitHub, implementing CI/CD pipelines for consistent deployment.
• Document reusable modules, validation schemas, and utilities to streamline development and promote best practices.
• Collaborate with cross-functional teams to support data engineering and validation projects in a high-volume environment.

Key Skills:

• Bachelor’s degree in computer science, software engineering, or a related field.
• Minimum of five years of professional experience in Python development, automation, and data validation.
• Strong proficiency in Python, including frameworks such as pytest, Pandas, Requests, JSON, and logging.
• Extensive experience with FastAPI, Pydantic, BaseModel, and SQLAlchemy ORM for API backends.
• Proven expertise working with PostgreSQL and Snowflake databases, including secure connections.
• Demonstrated ability to automate validation processes between APIs and databases for accuracy and consistency.
• Experience with REST API integration, using Requests, FastAPI, and Uvicorn, with structured JSON handling.
• Familiarity with version control (GitHub) and Agile project management tools (Jira).
• Solid understanding of CI/CD pipelines, API authentication methods (JWT, OAuth2), and data integrity testing practices.
• Experience optimizing SQL queries, API endpoints, and system performance in high-volume contexts.
• Knowledge of data engineering workflows involving Databricks and large-scale validation environments.
• This position requires eligibility for a U.S. Government security clearance. In accordance with federal law, U.S. citizenship is required.

Salary (Rate): £40.00 Hourly

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT