Description
Remote
Our client seeks an Automated Test Engineer to support Hivemind by monitoring and maintaining large volumes of automated tests, troubleshooting failures, and driving bug resolution across teams. The role focuses on software automation, test reliability, and root-cause analysis in a complex environment spanning Python, C++, and Nix, with additional exposure to Go and TypeScript. The engineer will triage CI failures, distinguish product defects from test or infrastructure issues, and improve test suites, observability, and artifact collection.
Due to client requirements, applicants must be willing and able to work on a w2 basis. For our w2 consultants, we offer a great benefits package that includes Medical, Dental, and Vision benefits, 401k with company matching, and life insurance.
Responsibilities
- Monitor, execute, and troubleshoot GitLab CI pipelines for Hivemind SDK integration examples.
- Maintain integration, contract, smoke, and software-in-the-loop tests across missions, scenarios, deployments, analyzers, and evaluators.
- Reproduce CI failures locally using the same packages and targets exercised in the pipeline.
- Triage failures into product regressions, test defects, dependency or lockfile issues, configuration or schema mismatches, CI runner or infrastructure failures, and intermittent or flaky behavior.
- Analyze logs, JUnit reports, configurations, runtime artifacts, MCAP or rosbag recordings, telemetry, and evaluator results.
- Produce clear defect reports with failure signatures, affected revisions, reproduction steps, evidence, suspected ownership, and next actions.
- Partner with feature and platform teams to diagnose and verify fixes across repositories and package boundaries.
- Maintain SDK examples and update tests as supported APIs or dependency contracts change.
- Improve test reliability, observability, runtime, failure messages, and artifact collection.
- Identify flaky tests and implement corrective actions rather than relying on retries.
- Add regression coverage for diagnosed defects and untested integration boundaries.
- Document test procedures, known issues, prerequisites, and troubleshooting guidance.
- Track test health, recurring failure modes, time to triage, and unresolved integration risks.
- Support testing across x86 and ARM targets and, where applicable, SIL, HIL, RIL, containerized, and Kubernetes environments.
Experience Requirements
- Professional experience in software testing, software integration, CI/CD, or software development.
- Strong Python skills with experience reading and modifying production or test code.
- Strong Linux command-line and debugging skills.
- Experience with Git, merge requests, code review, and GitLab CI or a comparable CI system.
- Ability to interpret stack traces, test reports, application logs, and build-system output.
- Experience diagnosing failures in multi-service or multi-repository systems.
- Understanding of unit, integration, regression, and end-to-end testing practices.
- Ability to isolate problems, create minimal reproductions, and communicate findings clearly.
- Strong written communication focused on technical evidence and reproducibility.
- Ability to collaborate across teams and follow issues through verification and closure.
- Preferred: Experience with Nix, reproducible build systems, or dependency lockfiles.
- Preferred: Experience with Docker, Kubernetes, and containerized CI runners.
- Preferred: Familiarity with C++, ROS, MCAP, or rosbag data.
- Preferred: Experience with simulation, robotics, autonomy, avionics, or distributed real-time systems.
- Preferred: Familiarity with SIL or HIL testing.
- Preferred: Experience debugging networking, serialization, schema, and configuration compatibility issues.
- Preferred: Experience testing across x86 and ARM architectures.
- Preferred: Familiarity with test telemetry, metrics, analyzers, and fail-closed acceptance criteria.
- Preferred: Experience improving flaky-test detection, CI observability, and automated artifact collection.