Position: Subject Matter Experts: Machine Learning Model Evaluation
Type: Hourly Contract
Compensation: $150/hr
Location: Remote
Commitment: The project involves approximately five hours of independent work, which you can complete asynchronously.
Role Responsibilities
- Review machine learning model outputs generated in response to research prompts.
- Rate AI-generated responses for accuracy, relevance, and factual correctness using a structured rating system.
- Provide clear written justifications for evaluation scores.
Requirements
- Professional or academic expertise in a specialized domain.
- Strong critical thinking, analytical skills, and attention to detail.
- Comfortable reading and assessing complex technical or research-focused text; experience evaluating technical content or research data is welcome.
- ML PhD researchers published at NeurIPS, ICML, ICLR, COLM, or RLC are especially encouraged to apply.
Application Process
Apply using the Easy Apply button and submit your application.
Applications will be reviewed based on the role requirements.
Eligible candidates will receive a message in their LinkedIn or email inbox with instructions to continue the application process.
Follow the instructions in the message to complete the remaining application steps.