About the Role
We're looking for a high-taste engineer with a strong eye for quality - someone who's worked hands-on with preference data and rubric creation, and knows what separates a good example from a great one.
You communicate clearly and can synthesize complex technical work the way a strong MAI dev would: concise, structured, and easy for others to act on.
You're comfortable in ambiguous, fast-moving environments and default to shipping over deliberating.
What does day-to-day look like:
- Design, refine, and iterate on rubrics and evaluation criteria for preference data
- Review and label data with a high bar for quality, catching subtle issues others might miss
- Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows
- Synthesize findings from data work into clear write-ups, updates, or recommendations for the team
- Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes
Required Skills:
- 5+ yrs of proficiency in Python (especially building/maintaining pipelines and infra) or Typescript (experience contributing to or navigating large codebases like VSCode a plus)
- Hands-on experience with preference data collection and/or rubric creation
- Strong written and verbal communication - able to distill technical work into clear, actionable summaries
- Demonstrated high-taste judgment - able to articulate why something is good, not just that it is
Evaluation Process (approximately 30 mins):
- One round of interview (30 mins of technical & cultural discussion
Rate:
Not specified
Location:
Remote
IR35 Status:
Not specified
Remote Status:
Remote
Industry:
IT
Seniority Level:
Senior