Elastic Observability Architect

Elastic Observability Architect

Posted Today by Vaarida Technologies llc

Negotiable
Undetermined
Remote
Remote or Chicago, Illinois

Summary: The Elastic Observability Architect role involves architecting, configuring, and managing the ELK Stack to enhance logging, monitoring, and observability across the enterprise. The position requires collaboration with cross-functional teams to design dashboards and optimize ELK performance while implementing data pipelines and advanced analytics. The architect will also provide training and mentorship to team members on ELK best practices. This role is primarily remote but is based in Chicago, Illinois.

Key Responsibilities:

  • Architect, configure, and manage the ELK Stack to support logging, monitoring, and observability needs across the enterprise.
  • Collaborate with cross-functional teams to understand business requirements and design dashboards, alerts, and reports for various stakeholders.
  • Optimize and troubleshoot ELK performance, including tuning Elasticsearch for efficient storage and retrieval of large datasets.
  • Develop and implement data pipelines with Logstash and other ingestion tools, ensuring reliable data flow from diverse data sources.
  • Enable advanced analytics and data visualizations in Kibana to provide actionable insights for IT operations.
  • Implement security, access controls, and best practices within the ELK environment.
  • Train and mentor team members on ELK best practices and provide technical support as needed.
  • Elasticsearch / Elastic Stack (Expert level)
  • Logstash, Beats, Kafka or similar ingestion tools

Key Skills:

  • Expertise in Elasticsearch / Elastic Stack, including distributed cluster design, indexing, sharding, and query DSL.
  • Performance tuning and optimization skills for large-scale data handling.
  • Experience with high availability and disaster recovery strategies.
  • Knowledge of index lifecycle management and data streams.
  • Proficiency in troubleshooting and production support.
  • Familiarity with Logstash, Beats, Kafka, or similar ingestion tools.
  • Experience with cloud platforms (AWS/Azure/Google Cloud Platform).
  • Proficiency in Docker and Kubernetes.
  • Experience with CI/CD and Infrastructure as Code (Terraform/Ansible).
  • Security knowledge (RBAC, TLS) and programming/scripting skills (Python/Java).

Salary (Rate): undetermined

City: Chicago

Country: United States

Working Arrangements: remote

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role -Elastic Observability Architect

Location - Chicago IL - Remote

Job type- Full Time Employment

Job description Below

  • Architect, configure, and manage the ELK Stack to support logging, monitoring, and observability needs across the enterprise.
  • Collaborate with cross-functional teams to understand business requirements and design dashboards, alerts, and reports for various stakeholders.
  • Optimize and troubleshoot ELK performance, including tuning Elasticsearch for efficient storage and retrieval of large datasets.
  • Develop and implement data pipelines with Logstash and other ingestion tools, ensuring reliable data flow from diverse data sources.
  • Enable advanced analytics and data visualizations in Kibana to provide actionable insights for IT operations.
  • Implement security, access controls, and best practices within the ELK environment.

  • Train and mentor team members on ELK best practices and provide technical support as needed.
  • Elasticsearch / Elastic Stack (Expert level)
    • Distributed Cluster Design & Architecture
    • Indexing, Sharding & Query DSL (deep expertise)
    • Performance Tuning & Optimization
    • Large-scale data handling (logs, metrics, search)
    • High Availability (HA) & Disaster Recovery (DR)
    • Index Lifecycle Management (ILM) & Data Streams
    • Troubleshooting & Production Support (cluster, latency issues)
    • System Design & Architecture ownership
    • Leadership (technical guidance, design reviews, mentoring)
  • Logstash, Beats, Kafka or similar ingestion tools
    • Kibana dashboards and monitoring
    • Cloud platforms (AWS/Azure/Google Cloud Platform)
    • Docker and Kubernetes
    • CI/CD and Infrastructure as Code (Terraform/Ansible)
    • Security (RBAC, TLS)
    • Programming/scripting (Python/Java)