Senior Data Engineer
Posted Today by Hexaware Technologies
Negotiable
Undetermined
Undetermined
London Area, United Kingdom
Summary: The Senior Data Engineer will play a crucial role in shaping the future of financial services by building and maintaining modern data platforms. This position requires collaboration with business and technology partners to deliver impactful solutions while ensuring performance and stability of data systems. The engineer will contribute to architectural design and development, focusing on data pipelines and quality assurance. A strong technical background in programming and cloud services is essential for success in this role.
Key Responsibilities:
- Architect and Develop: Contribute to the platform’s architectural design and build integration, modeling, data persistence, and analytical systems.
- Data Pipelines: Implement, maintain, and test robust data pipelines.
- Metadata Management: Develop and manage metadata processes and tools.
- Performance Monitoring: Ensure the stability and performance of data pipelines.
- Data Quality: Implement tools for data curation, metadata management, and quality assurance.
- Collaboration: Engage with business and technology teams to align the platform with organizational goals.
Key Skills:
- Programming: 10+ years of experience in Java and Python development.
- Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).
- Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.
- Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.
- Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.
- Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.
- RDBMS: Knowledge of PostgreSQL is a plus.
- Industry Experience: Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.
Salary (Rate): undetermined
City: London Area
Country: United Kingdom
Working Arrangements: undetermined
IR35 Status: undetermined
Seniority Level: undetermined
Industry: Other
Join a dynamic team shaping the future of financial services by building and maintaining modern data platforms. This role involves collaborating with business and technology partners to deliver impactful solutions, leveraging cutting-edge tools and technologies. You will contribute to the architectural design, development, and maintenance of data platforms, ensuring performance, stability, and alignment with business needs.
Key Responsibilities:
- Architect and Develop : Contribute to the platform’s architectural design and build integration, modeling, data persistence, and analytical systems.
- Data Pipelines : Implement, maintain, and test robust data pipelines.
- Metadata Management : Develop and manage metadata processes and tools.
- Performance Monitoring : Ensure the stability and performance of data pipelines.
- Data Quality : Implement tools for data curation, metadata management, and quality assurance.
- Collaboration : Engage with business and technology teams to align the platform with organizational goals.
Preferred Technical Skills:
- Programming : 10+ years of experience in Java and Python development.
- Cloud Expertise : Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).
- Data Platforms : Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.
- Workflow Orchestration : Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.
- Data Services : Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.
- Metadata Tools : Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.
- RDBMS : Knowledge of PostgreSQL is a plus.
- Industry Experience : Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.