Need KDB+ / Q Engineer - Remote!!!!!!

Need KDB+ / Q Engineer - Remote!!!!!!

Posted 6 days ago by 1759393703

Apply
Negotiable
Outside
Remote
USA
Apply
Dashboard Data Ingestion File Servers Generic Programming Low Latency Management Performance Analytics Profiling (Computer Programming) Query Performance Software Development Time Series Topology

Summary: The KDB+ / Q Engineer role focuses on developing monitoring and alerting capabilities for a large-scale KDB+ deployment within a client’s infrastructure. The engineer will assess current server deployments, evaluate existing monitoring tools, and design analytics dashboards to optimize performance and resource utilization. This position is fully remote and emphasizes proactive management of KDB+ systems to ensure efficiency and reliability. The role requires expertise in KDB+ and the Q programming language, along with experience in performance analytics and telemetry.

Key Responsibilities:

  • Assess current KDB+/Q server deployment, usage patterns, and SLAs.
  • Capture inventory of available metrics, logs, and traces.
  • Analyze data ingestion and query pathways, including latency and throughput.
  • Evaluate existing monitoring tools and identify gaps in monitoring coverage.
  • Analyze integration points and data consumption patterns of applications interacting with KDB+.
  • Design and implement analytics dashboards visualizing Service Level Indicators (SLIs).
  • Generate automated reports on server environment profiles and resource utilization.
  • Identify and profile slow or resource-intensive queries with optimization suggestions.
  • Create a performance dashboard for real-time monitoring of defined metrics.

Key Skills:

  • Expertise in KDB+ and Q programming language.
  • Experience with monitoring tools (e.g., Cerebro, Telegraf).
  • Strong analytical skills for performance assessment and optimization.
  • Ability to design and implement telemetry dashboards.
  • Knowledge of server environments and resource utilization analysis.
  • Experience in identifying and optimizing query performance.

Salary (Rate): undetermined

City: undetermined

Country: USA

Working Arrangements: remote

IR35 Status: outside IR35

Seniority Level: undetermined

Industry: IT

Detailed Description From Employer:

Role: KDB+ / Q Engineer

Location: Remote

Duration: Long Term

Primary skill: KDB+ / Q (KDB+ is an ultra low latency high performance time series DB that is used by quant / trading firms that drive millisecond efficiency). Q is the programming language to interact with KDB+ databases.

Scope: Client has a huge installation of on-premises instances / servers (e.g., KDB deployment). The vision is to develop monitoring / alerting capability to sense when bottlenecks might happen, to proactively address these situations, and build state-of-the-art

Discovery

  • Current KDB+/Q server deployment, usage patterns, and SLAs
  • Capture Inventory of available metrics, logs, and traces
  • Capture data ingestion and query pathways, including latency and throughput

Assessment

  • Evaluate existing monitoring tools (i.e., Cerebro, Telegraf, custom tools) used in monitoring and managing the KDB+ ecosystem and custom code
  • Identify gaps or inefficiencies in current monitoring coverage
  • Analyze the integration points and data consumption patterns of applications interacting with KDB+
  • Understand key application dependencies and performance considerations

Analytics/Telemetry Dashboard

  • Design and implementation of dashboards by aligning with Client on what level the dashboards will be aggregated at, and then to visualize Service Level Indicators (SLIs) such as disk space utilization, query latency, system availability, CPU/memory usage, and error rates
  • Recommendations for SLI thresholds and alerting

Deliverables

Overall Optimization of Telemetry:

  • Server environment profile report: Generate automated report based on programmatically collected info on server specs, KDB versions, process topology, and deployment architecture
  • Data aggregation (Process & Session): List of in-scope running processes, user sessions, and their configurations, and aggregating the data for analysis
  • Resource Utilization and Server Log Analysis: Report and dashboard summarizing latency, CPU, memory, disk, and network usage patterns, and recommendations for tuning and optimization to Client team to perform
  • Query Performance Analysis: Identification and profiling of slow or resource-intensive queries, with optimization suggestions
  • Performance Dashboard: Visual dashboard for real-time monitoring of defined metrics

Regards,

Radiantze Inc

Apply
Similar Jobs
Loading data...