Content Evaluator (Remote)

Job Title : Content Evaluator (Remote)

Employment Type: Remote, part-time independent contractor

Location: Remote within United States, United Kingdom, Canada, Ireland, Australia & New Zealand (You must be legally authorised to work in the country where you are based)

Compensation: $35 - $45 per hour based on location, experience, responsibilities, and performance.

Role Overview: We are hiring on behalf of one of our clients, a leading global player in the AI space. This remote, part-time contract role is centered on assessing the quality and relevance of AI-generated content. You will act as a critical judge, reviewing model outputs against strict guidelines to ensure they are helpful, honest, and harmless. Your feedback provides the essential data signals needed to refine the AI's performance and decision-making processes.

Key Responsibilities:

• Evaluate pairs of AI-generated responses (Side-by-Side comparisons) to determine which version is superior based on criteria like fluency, coherence, and helpfulness.
• Assess content for factual accuracy, using search tools to verify claims and identify "hallucinations" or misleading information.
• Flag content for safety violations, ensuring the model does not produce biased, toxic, or inappropriate material.
• Provide clear, objective written feedback explaining the reasoning behind your ratings to help engineers understand model failures.
• Verify that the AI has correctly followed complex constraints within a prompt (e.g., word count limits, formatting styles, or tone requirements).

Qualifications:

• Native-level command of the English language with a strong grasp of cultural nuances and idioms.
• Ability to internalize and apply complex grading rubrics and guidelines without deviation.
• Strong research skills to quickly verify facts across a wide range of topics (general knowledge).
• Objective, analytical mindset with the ability to set aside personal bias when evaluating subjective topics.
• Comfortable working independently in a remote environment, managing time across multiple projects.

Compensation and Benefits:

Rate: Earn up to $45 USD/hr (Rates vary based on project complexity and expertise).

Flexibility: 100% remote with no fixed schedule. Contributors typically spend 5–10 hours per week, with the option to work up to 40 hours.

Equal Opportunity Employer: We're committed to fostering a diverse and inclusive work environment. We welcome applicants from all backgrounds and celebrate diversity in our workforce.