Sr. Kafka Engineer with snowflake & Terraform

Sr. Kafka Engineer with snowflake & Terraform

Posted 7 days ago by 1752576893

Apply
Negotiable
Outside
Remote
USA
Apply
Amazon Managed Streaming for Apache Kafka (Amazon MSK) Apache Kafka Azure DevOps Big Data Change Data Capture (CDC) Cloud Computing Cloud Technology Computer Science Confluent Continuous Integration and Continuous Delivery DevOps File Servers Information Systems Information Technology Infrastructure as Code (IaC) Java (Programming Language) JSON Management Management Information Systems Microsoft Azure Microsoft SQL Servers Python (Programming Language) Role-Based Access Control (RBAC) Scala (Programming Language) Snowflake (Data Warehouse) Software Development SQL (Programming Language) SSL Security Terraform

Summary: The role of Kafka Engineer involves designing, implementing, and maintaining real-time streaming solutions using Confluent Kafka, Terraform, and DevOps pipelines. The candidate will work closely with DevOps and infrastructure teams to stream data from SQL Server to Snowflake. This position offers flexibility to work remotely and requires strong experience with TFS and infrastructure as code. The ideal candidate should possess hands-on experience with the Kafka ecosystem and related technologies.

Key Responsibilities:

  • Design, implement, and maintain real-time streaming solutions using Confluent Kafka and Terraform.
  • Stream data from SQL Server to Snowflake using CDC.
  • Collaborate with DevOps and infrastructure teams.
  • Manage Kafka infrastructure using Terraform.
  • Integrate Kafka with Snowflake using connectors or Snowpipe Streaming.
  • Utilize CI/CD pipelines with Azure DevOps (TFS).
  • Work on cross-team collaboration involving Data, DevOps, and Cloud.

Key Skills:

  • Strong hands-on experience with Apache Kafka / Confluent Kafka ecosystem.
  • Expertise in Kafka Connect, Kafka Streams, or ksqlDB.
  • Practical experience in streaming data from SQL Server using CDC.
  • Experience integrating Kafka with Snowflake.
  • Proficiency in Terraform.
  • Working knowledge of CI/CD pipelines using Azure DevOps (TFS).
  • Familiarity with Confluent Schema Registry and serialization formats.
  • Good scripting/programming experience with Python, Java, or Scala.
  • Experience in cross-team collaboration.
  • Confluent Certified Developer or Terraform Associate Certification preferred.
  • Understanding of Kafka security and cloud-native Kafka solutions.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Hi, this is Srikanth from Reliable Software. We have an opportunity with one of our direct clients, and I'd like to share the details with you. Please review the information below and let me know if you're interested. Kindly share your updated resume if you'd like to be considered.

Job Title: Kafka Engineer

Location: Remote

Mandatory Skills - Confluent Kafka, SQL CDC,Kafka Implementation, Snowflake & Terraform

Job Description:

We are looking for a hands-on Kafka Streaming Engineer with expertise in Confluent Kafka, Terraform, and DevOps pipelines to design, implement, and maintain real-time streaming solutions. The ideal candidate will help stream data from SQL Server (using CDC) to Snowflake, working closely with DevOps and infrastructure teams. The role offers flexibility to work either onshore , and requires strong experience with TFS (Azure DevOps) and infrastructure as code (IaC) using Terraform.


Required Skills & Qualifications
Strong hands-on experience with Apache Kafka / Confluent Kafka ecosystem.
Expertise in Kafka Connect, Kafka Streams, or ksqlDB.
Practical experience in streaming data from SQL Server using CDC.
Experience integrating Kafka with Snowflake using connectors or Snowpipe Streaming.
Proficiency in Terraform to manage Kafka infrastructure.
Working knowledge of CI/CD pipelines using Azure DevOps (TFS).
Familiar with Confluent Schema Registry and serialization formats (Avro, JSON).
Good scripting/programming experience with Python, Java, or Scala.
Experience in cross-team collaboration (Data/DevOps/Cloud).
Preferred Qualifications
Confluent Certified Developer or Terraform Associate Certification.
Familiarity with Snowpipe Streaming, Kafka REST Proxy, or custom connector development.
Understanding of Kafka security: SSL, SASL, RBAC.
Exposure to cloud-native Kafka solutions (e.g., Confluent Cloud on AWS/Azure).Job Title: Confluent Kafka Streaming Engineer (Terraform | SQL CDC | Snowflake)

Educational Qualifications:

  • Required - Bachelor s degree in Computer Science, Information Technology, Computer Engineering or closely related or equivalent.
  • Preferred - Master s degree in Management Information Systems (MIS), Computer Science, Big Data or Analytics or equivalent.

Travel:

  • Open to travel based-up on the nature of the engagement.

Thanks & Regards

Srikanth Donkani

Lead Talent Acquisition Specialist

(w):

(E):

;/p>

2260 Haggerty Road, Suite 285 Northville, MI 48167

Equal Employment Opportunity

Reliable Software employment does not discriminate on the basis of race, religion, gender, sexual orientation, age or any other basis as covered by federal, state, or local law.

Employment decisions are based solely on qualifications, merit and business needs.

Apply
Similar Jobs
Loading data...