Fully Remote and Freelance Project- 8-10 hours per week expected as a minimum
As a legal expert you'll grade AI legal reasoning against the standard of a careful practitioner and write the analysis the model should have produced.
We are looking for experienced legal professionals to evaluate how frontier AI models handle real legal work: research memos, contract review and drafting, motion and brief sections, compliance analyses, due diligence summaries and regulatory responses. You bring the judgment you have built marking up a junior's memo, checking a research trail before relying on it, and redlining a draft until it is the one you would sign. We bring the model output that judgment is needed to grade.
This is not a traditional law role. You will be helping build better AI by putting your knowledge to work in a structured, flexible, fully remote environment.
Responsibilities
- Draft prompts that test how models handle contracts, statutes, procedure, and case analysis.
- Review AI output for invented citations, misapplied precedent, and jurisdictional errors, and rate the reasoning.
- Write the correct analysis when the model falls short, with the clarity of a well-drafted memo
- In this role, you will design challenging, realistic tasks drawn from your own practice, such as a research memo on a discrete question, a contract redline with an issues list, a section of a motion or brief, a compliance gap analysis, a due diligence summary, a discovery plan, or a response to a regulator, run them through frontier AI agents, and evaluate what comes back against a professional standard.
- You will work with realistic professional files, the kind a practitioner in your field actually handles, which you assemble yourself. Some tasks are compact, built around a handful of files; others are larger scenarios that take several days to build. In every case the goal is the same: a task a competent professional in your field would complete correctly and a frontier model currently gets wrong.
You will Bring
- Sharp legal research and writing skills across at least one practice area.
- Clear written English: your explanations are the training signal.
- Open to candidates from the US/UK and Canada