Data Engineer

Role Description

A Data Engineer is responsible for designing, building, and maintaining scalable data pipelines and data platforms that enable reliable data ingestion, transformation, storage, and consumption across the organization.

The role focuses on ensuring data availability, quality, security, and performance to support analytics, reporting, AI/ML, and business decision-making initiatives.

Data Engineers collaborate closely with architects, analysts, and business stakeholders to deliver robust and efficient data solutions.

Key Responsibilities

• Design, develop, and maintain end-to-end data pipelines and ETL/ELT processes.
• Build and optimize data warehouses, data lakes, and cloud-based data platforms.
• Integrate data from multiple internal and external sources.
• Ensure data quality, integrity, security, and governance standards are maintained.
• Monitor and troubleshoot data pipelines to ensure reliability and performance.
• Collaborate with Data Architects, Data Analysts, and business teams to support data and analytics requirements.
• Implement data modeling, transformation, and performance optimization best practices.
• Support advanced analytics, reporting, and AI/ML initiatives through scalable data engineering solutions.

Key Skills

Python, SQL, ETL/ELT, Data Warehousing, Data Lakes, Spark, Hadoop, Azure Data Factory, Databricks, Snowflake, Kafka, Cloud Platforms (Azure/AWS/GCP), Data Modeling, Data Governance, Performance Optimization, and CI/CD.