Accountabilities
- Evaluate AWS Trainium and Neuron Kernel Interface tasks to determine whether they are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
- Review model compilation workflows and accelerator optimization approaches for technical correctness and practical effectiveness.
- Assess NKI-based tasks and kernel execution scenarios for potential implementation issues, unexpected behavior, and technical inconsistencies.
- Identify hardware acceleration inefficiencies, kernel execution bugs, logic errors, and other issues that may compromise task quality or evaluation accuracy.
- Rigorously test and troubleshoot complex technical scenarios to validate expected behavior and task outcomes.
- Provide clear, actionable technical feedback that enables task authors and evaluators to resolve identified issues and improve task quality.
- Apply deep expertise in AWS Trainium architecture and AI acceleration to ensure training and evaluation workflows meet high technical standards.
- Document technical findings clearly and consistently across assigned project tasks.
Requirements
- Demonstrable professional experience and deep technical knowledge of AWS Trainium architecture, including model compilation, accelerator optimization, and Neuron Kernel Interface (NKI) frameworks.
- Strong understanding of AI accelerator workloads and the technical considerations involved in optimizing models and kernels for specialized hardware.
- Strong analytical and problem-solving skills, with the ability to rigorously test, troubleshoot, and evaluate complex technical scenarios.
- Strong attention to detail and the ability to identify subtle performance, execution, integration, and logic issues.
- Ability to assess technical tasks objectively against requirements for accuracy, realism, reproducibility, and reliable evaluation.
- Strong written communication skills for providing precise, constructive, and actionable technical feedback.
- Ability to work independently and apply specialized technical expertise within a freelance, project-based environment.
- Candidates will be evaluated for one area of specialization based on their professional experience; expertise across multiple technical domains is not required.
- Ability to provide a secure computer and reliable high-speed internet connection for freelance project work.
Benefits
- Compensation of $70–$100 per hour, with the exact rate determined based on experience, expertise, and geographic location.
- Final compensation may vary from the published range following evaluation of your qualifications and location.
- Freelance contract structure offering flexibility for project-based work.
- Remote work environment.
- Opportunity to contribute directly to the training and evaluation of advanced AI systems.
- Opportunity to apply specialized AWS Trainium and NKI expertise to technically challenging AI evaluation projects.
- Health insurance, paid time off, and other company-sponsored employee benefits are not provided under the freelance contract.
- Contractors are responsible for supplying their own secure computer and high-speed internet connection.
Industry:
AI & Machine Learning
Seniority Level:
Not Specified