English Writing Specialist (Remote)
Posted Today by Keystone Recruitment
Negotiable
Undetermined
Remote
United Kingdom
Summary: The English Writing Specialist role is a remote, independent contractor position focused on evaluating and improving the performance of large language models (LLMs) used in AI systems. The specialist will review AI-generated responses, provide feedback, and ensure outputs meet high standards of correctness and tone. Candidates must be legally able to work as independent contractors in their jurisdiction, with a strong emphasis on analytical skills and attention to detail. This position offers flexible scheduling and the opportunity to influence AI communication globally.
Key Responsibilities:
- Evaluate AI-generated responses to user questions
- Perform fact-checking using trusted public sources and tools
- Annotate response strengths, weaknesses, and factual inaccuracies
- Assess reasoning quality, clarity, tone, and completeness
- Ensure outputs follow conversational and safety guidelines
- Apply structured evaluation rubrics and benchmarks
Key Skills:
- Bachelor’s degree
- Native-level or fluent English
- Experience using large language models (LLMs)
- Excellent written communication and analytical skills
- High attention to detail
- Comfortable working across a wide range of topics
- Background in structured or analytical fields (e.g., research, policy, analytics, linguistics, engineering)
- Strong college-level mathematics skills
- Experience with RLHF, model evaluation, or data annotation (nice to have)
- Editing, writing, or content review experience (nice to have)
- Ability to compare multiple outputs and make fine-grained quality judgments (nice to have)
- Familiarity with evaluation frameworks and scoring rubrics (nice to have)
Salary (Rate): undetermined
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Title: English Writing Specialist (Remote)
Engagement: Hourly contract (independent contractor)
Rate: USD 45/hour
Location: Remote – candidates based in the United States, United Kingdom, Canada, Europe, Singapore, Dubai, or Australia who are legally able to work as independent contractors in their jurisdiction.
Role Overview
One of our clients works with leading AI research teams to improve the quality, reliability, and usefulness of large language models (LLMs). These systems are used across everyday and professional settings, so accurate, clear, and well-reasoned responses are essential. This role focuses on evaluating and improving general conversational AI behavior . You will review model-generated responses, provide expert human feedback, and help ensure AI outputs meet high standards for correctness, tone, and usefulness.
Key Responsibilities
- Evaluate AI-generated responses to user questions
- Perform fact-checking using trusted public sources and tools
- Annotate response strengths, weaknesses, and factual inaccuracies
- Assess reasoning quality, clarity, tone, and completeness
- Ensure outputs follow conversational and safety guidelines
- Apply structured evaluation rubrics and benchmarks
Required Qualifications
- Bachelor’s degree
- Native-level or fluent English
- Experience using large language models (LLMs)
- Excellent written communication and analytical skills
- High attention to detail
- Comfortable working across a wide range of topics
- Background in structured or analytical fields (e.g., research, policy, analytics, linguistics, engineering)
- Strong college-level mathematics skills
Nice to Have
- Experience with RLHF, model evaluation, or data annotation
- Editing, writing, or content review experience
- Ability to compare multiple outputs and make fine-grained quality judgments
- Familiarity with evaluation frameworks and scoring rubrics
What Success Looks Like
- You detect factual mistakes, reasoning gaps, and communication flaws
- Your feedback improves the accuracy and clarity of AI responses
- You produce consistent and reproducible evaluation results
- AI systems become more reliable because of your work
Why Join
One of our clients is building next-generation human-in-the-loop AI systems used globally. This flexible, remote role gives you the opportunity to directly influence how AI communicates with users in English.
Contract & Payment Terms
- Independent contractor
- Fully remote with flexible scheduling
- Weekly payments via Stripe or Wise
- Projects may be extended or concluded based on performance and business needs
- No access to confidential or proprietary employer data
- H1-B and STEM OPT not supported