Android AI System SDET

Summary: The Android AI System SDET role focuses on validating AI functionality and performance on Android devices through comprehensive testing and automation. Responsibilities include designing evaluation datasets, executing test plans, and collaborating with cross-functional teams to enhance software quality. The position requires strong coding skills and familiarity with Android debugging tools, as well as experience in AI model testing. The role is based in London and involves working with distributed teams across various locations.

Key Responsibilities:

• Validate AI functionality for stability, compatibility, and correctness on Android devices.
• Design AI evaluation datasets to improve data quality, coverage, and accuracy.
• Understanding of machine learning model validation processes.
• Create, maintain, and execute manual and automated test plans for new and existing features, including production readiness certification.
• Verify on-device resource utilization (memory, CPU, battery) meets performance thresholds.
• Conduct regression, feature, and experimental testing; maintain up-to-date test suites and documentation.
• Use ADB, logcat, and tombstone to diagnose system anomalies, reproduce edge cases, and help resolve defects.
• Perform first-level triage of incoming issues, escalating unresolved or complex bugs within defined SLAs.
• Log, track, and verify defects; incorporate feedback from engineering teams.
• Execute microbenchmarks, ACT (Android Compatibility Test), and other performance tests.
• Monitor memory usage, boot time, and other KPIs; provide optimization recommendations.
• Perform soundness checks and benchmark AI models (e.g., perplexity, XSum, coco_text).
• Design, implement, and optimize automation frameworks to expand test coverage and efficiency.
• Develop SQL queries and dashboards to visualize test results, anomalies, and quality metrics.
• Maintain test scripts, configurations, and continuous integration pipelines (e.g., Jenkins, GitLab CI).
• Monitor and manage automated/manual builds, tests, and releases of software, models, and configurations.
• Update test code/configurations to address new scenarios and patterns.
• Write detailed technical documentation, SOPs, and test reports.
• Generate weekly status updates highlighting blockers, risks, and action plans.
• Work across distributed teams (Taipei, London, Mountain View) ensuring EOD handoffs.
• Collaborate with developers, project managers, and QA teams to refine test strategy.

Key Skills:

• Proficiency in C++, Python, Java, shell scripting, and SQL; strong coding/debugging skills.
• Experience with Android debugging tools (ADB, logcat, tombstone).
• Familiarity with Android system architecture, AOSP, HAL, JNI, and AIDL.
• Experience in AI model testing, dataset design, and quality analysis.
• Knowledge of CI/CD frameworks and Git-based workflows.
• Strong communication skills in English and ability to work in cross-functional teams.
• Ability to interpret and analyze model performance metrics and data.
• Experience with Tradefed, NNAPI, TFLite.
• Skills in data warehousing, cron automation, and metric tracking.
• Experience in global, agile development environments.

Salary (Rate): undetermined

City: London

Country: United Kingdom

Working Arrangements: undetermined

IR35 Status: undetermined

Seniority Level: undetermined

Industry: IT