Android AI System SDET Engineer

We are seeking an Android AI system SDET engineer to join a high-impact team supporting one of the world’s largest operating systems. In this role, you will validate AI functionality on Android devices, ensuring stability, compatibility, and correctness. You will collaborate closely with developers to analyze issues, maintain test code, perform system debugging, and analyze data. You will design and execute diverse test cases to help ensure the on-device AI system meets high-quality standards through automation testing, quality analysis, and dashboard development.

Key Responsibilities:

• AI Testing & Debugging
• Validate AI functionality on Android devices for stability, compatibility, and correctness
• Assist in creating and refining AI evaluation datasets to continuously improve data quality, coverage, and accuracy
• Perform manual testing and edge case reproduction using command-line tools to capture potential issues
• Use tools such as ADB, logcat, and tombstone to deeply analyze anomalies and quickly locate and help fix defects
• Performance & Benchmark Testing
• Execute and monitor microbenchmarks and ACT (Android Compatibility Test) suites to ensure system performance stability
• Continuously track and analyze memory usage and regression issues to ensure resource optimization
• Measure and analyze system boot time and other key performance indicators, providing optimization recommendations
• Testing, Automation & Failure Triage
• Design and implement automation testing frameworks to improve test coverage and efficiency
• Write and optimize SQL queries to analyze test results and system data to support decision-making
• Assist in designing and building internal dashboards for real-time visualization of test results, anomalies, and quality analysis
• Generate regular test reports summarizing findings and suggesting improvement plans
• Cross-team Collaboration & Communication
• Write clear and detailed test plans, SOPs, and technical documentation to ensure knowledge sharing and process consistency
• Collaborate closely with project managers, developers, and other relevant teams to provide feedback and improvements on AI evaluation datasets and test results
• Actively participate in team meetings and technical discussions to facilitate cross-team communication and promote test strategy optimization

Required Qualifications

• Proficient in C++ programming and test development with strong coding and debugging skills
• Skilled in shell scripting and SQL querying, able to independently develop automation scripts and perform data analysis
• Experienced in using Android debugging tools such as ADB, logcat, and tombstone for system diagnosis and troubleshooting
• Familiar with CI/CD frameworks, such as Jenkins and GitLab CI, for continuous integration
• Knowledgeable in Git version control and code review processes, with strong teamwork skills
• Familiar with Android system architecture, AOSP build, HAL, JNI, and AIDL components
• Experience in AI model testing or evaluation, with understanding of dataset design and management
• Capable of data analysis and visualization, able to design dashboards to support quality analysis and display key test metrics
• Excellent cross-team communication and technical documentation skills, with proficiency in English

Preferred Qualifications

• Experienced with Tradefed test framework and Android AI frameworks such as NNAPI and TFLite
• Skilled in data warehousing and metric tracking, including cron job automation, log parsing, and dashboard creation
• Familiarity with working in global teams and agile development practices