Data Engineer with Palantir !!! NY/NJ (Remote)

Summary: The role of Data Engineer with Palantir Experience involves designing scalable data solutions and building robust data pipelines, requiring 5-10 years of experience in data engineering, AWS, and microservices architecture. The ideal candidate will have hands-on expertise or certification in Palantir Foundry and familiarity with AI/ML frameworks. This position is remote and focuses on integrating machine learning models into data workflows. The candidate should also possess strong problem-solving skills and experience in agile environments.

Key Responsibilities:

• Design scalable data solutions and build robust data pipelines.
• Integrate machine learning models into data workflows.
• Develop ETL workflows and manage data pipelines in cloud environments.
• Utilize AWS services for data processing and storage.
• Implement microservices architecture and distributed systems.
• Work with big data technologies like Apache Spark, Kafka, and Snowflake.
• Optimize performance and solve complex data engineering problems.
• Apply modern DevOps practices, including CI/CD and container orchestration.
• Collaborate in agile environments to deliver data engineering solutions.

Key Skills:

• 5-10 years of experience in data engineering.
• Expertise or certification in Palantir Foundry.
• Strong knowledge of AWS services (S3, Glue, Athena, Lambda, Redshift).
• Proficiency in Python and PySpark.
• Understanding of microservices architecture and distributed systems.
• Familiarity with AI/ML tools (TensorFlow, PyTorch).
• Experience with big data technologies (Apache Spark, Kafka, Snowflake).
• Problem-solving and performance optimization skills.
• Exposure to DevOps practices and tools (Docker, Kubernetes).
• Experience in agile environments.

Salary (Rate): £50 - £60 hourly

City: undetermined

Country: undetermined

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT