Accountabilities
- Evaluate machine learning tasks to determine whether they are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
- Review model development workflows, data preprocessing pipelines, and machine learning implementations for technical correctness and practical relevance.
- Assess whether algorithms, training approaches, and expected outcomes are logically sound and appropriately defined.
- Identify data pipeline flaws, model training inefficiencies, algorithmic logic errors, and other technical issues that may compromise task quality.
- Rigorously test and troubleshoot complex machine learning scenarios to validate task behavior and expected results.
- Provide clear, actionable technical feedback on identified issues and recommend improvements where appropriate.
- Apply specialized machine learning knowledge to ensure AI training and evaluation tasks meet high standards of accuracy, rigor, and reproducibility.
- Document technical findings clearly and consistently across assigned project tasks.
Requirements
- Demonstrable professional experience and deep technical knowledge in Machine Learning, including model development and data preprocessing pipelines.
- Strong hands-on experience with machine learning frameworks such as PyTorch or TensorFlow.
- Strong understanding of machine learning algorithms, model training workflows, data preparation, and technical evaluation practices.
- Strong analytical and problem-solving skills, with the ability to rigorously test, troubleshoot, and evaluate complex technical scenarios.
- Excellent attention to detail and the ability to identify subtle data, model, algorithmic, testing, and reproducibility issues.
- Ability to objectively assess technical tasks against requirements for accuracy, realism, solvability, and reliable evaluation.
- Strong written communication skills for providing precise, constructive, and actionable technical feedback.
- Ability to work independently and apply specialized expertise within a freelance, project-based environment.
- Candidates will be considered for one area of specialization based on their professional experience; expertise across other domains is not required.
- Ability to provide a secure computer and reliable high-speed internet connection for freelance project work.
Benefits
- Compensation of $70–$100 per hour, with the exact rate determined based on experience, expertise, and geographic location.
- Final compensation may vary from the published range following evaluation of your qualifications and location.
- Freelance contract structure offering flexibility for project-based work.
- Remote work environment.
- Opportunity to contribute directly to the training and evaluation of advanced AI systems.
- Opportunity to apply specialized Machine Learning expertise to technically challenging AI evaluation projects.
- Health insurance, paid time off, and other company-sponsored employee benefits are not provided under the freelance contract.
- Contractors are responsible for supplying their own secure computer and high-speed internet connection.
Industry:
AI & Machine Learning
Seniority Level:
Not Specified