Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate each response against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, and potential legal inaccuracies.
- Provide concise, precise, and well-reasoned written feedback for every evaluation.
- Apply evaluation criteria consistently and objectively across assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in the United Kingdom.
- Strong command of UK law, particularly commercial and contract matters.
- Practical experience advising businesses and assessing real-world legal and commercial risks.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written English and the ability to communicate complex legal concepts clearly and concisely.
- Ability to distinguish legally accurate analysis from plausible but incorrect or incomplete reasoning.
- Comfortable working independently with structured evaluation rubrics.
- Strong ability to manage deadlines and consistently deliver high-quality assessments.
Engagement Details
Initial Commitment: Approximately 10 hours
Potential: Strong possibility of additional work based on project requirements and performance
Work Arrangement: Fully remote
Confidentiality: All project work will be subject to applicable confidentiality requirements and NDA obligations.
Engagement Type: Independent contractor
Contract and Payment Terms
This is a fully remote engagement that can be completed on a flexible schedule.
Projects may be extended, shortened, or concluded early depending on project requirements and performance.
Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
Payments are made weekly based on services rendered through supported payment platforms.