Senior Software Engineer — AI Code Ranking
Posted Today by Alignerr
Negotiable
Undetermined
Remote
London, England, United Kingdom
Summary: The role of Senior Software Engineer — AI Code Ranking involves evaluating and ranking AI-generated code to enhance AI systems' understanding of quality coding practices. Candidates will utilize their software engineering expertise to assess code on various factors such as correctness, efficiency, and readability. This fully remote position offers flexible hours and is designed for experienced developers looking for intellectually engaging work. The role requires a strong background in software engineering and the ability to communicate technical reasoning effectively.
Key Responsibilities:
- Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
- Evaluate code for functional accuracy — verifying that solutions produce correct outputs across standard and edge cases
- Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
- Identify bugs, logic errors, security issues, and performance bottlenecks in AI-generated code
- Write clear, structured justifications explaining your ranking decisions
- Work across multiple programming languages and problem domains — from algorithms and data structures to systems design and API integrations
- Complete task-based assignments independently on your own schedule
Key Skills:
- Senior-level software engineer with 5+ years of professional development experience
- Proficient in at least two of the following: Python, JavaScript/TypeScript, Java, C++, Go, or Rust
- Strong understanding of algorithms, data structures, and computational complexity
- Experienced in code review — able to quickly spot issues and articulate what makes one solution better than another
- Deep knowledge of software engineering best practices: clean code, design patterns, testing, and performance optimization
- Clear written communicator who can explain technical reasoning concisely
- Self-motivated and consistent when working independently without supervision
Salary (Rate): £38.00/hr
City: London
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: Senior
Industry: IT
About The Role
What if your deep software engineering expertise could directly shape how the next generation of AI writes code? We're looking for senior-level developers based in the London area to evaluate, compare, and rank AI-generated code — helping AI systems learn what separates good code from great code. You'll review pairs of code solutions, assess them on correctness, efficiency, readability, and best practices, and provide the preference rankings that teach AI models to produce better software. Your engineering judgment becomes the training signal that makes AI smarter. This is a fully remote, flexible contract role designed for experienced software engineers who want meaningful, intellectually engaging work on their own schedule.
Organization: Alignerr
Type: Hourly Contract
Location: Remote
Commitment: 10–40 hours/week
What You'll Do
- Compare pairs of AI-generated code solutions and rank them based on quality, correctness, and engineering best practices
- Evaluate code for functional accuracy — verifying that solutions produce correct outputs across standard and edge cases
- Assess code quality factors including readability, efficiency, maintainability, and adherence to idiomatic patterns
- Identify bugs, logic errors, security issues, and performance bottlenecks in AI-generated code
- Write clear, structured justifications explaining your ranking decisions
- Work across multiple programming languages and problem domains — from algorithms and data structures to systems design and API integrations
- Complete task-based assignments independently on your own schedule
Who You Are
- Senior-level software engineer with 5+ years of professional development experience
- Proficient in at least two of the following: Python, JavaScript/TypeScript, Java, C++, Go, or Rust
- Strong understanding of algorithms, data structures, and computational complexity
- Experienced in code review — you can quickly spot issues and articulate what makes one solution better than another
- Deep knowledge of software engineering best practices: clean code, design patterns, testing, and performance optimization
- Clear written communicator who can explain technical reasoning concisely
- Self-motivated and consistent when working independently without supervision
Nice to Have
- Experience with machine learning, AI/ML pipelines, or training data curation
- Background in competitive programming, technical interviewing, or algorithmic problem-solving
- Familiarity with RLHF (Reinforcement Learning from Human Feedback) or preference-based AI training
- Experience across both backend and frontend development
- Contributions to open-source projects or technical mentoring experience
- Knowledge of security best practices and common vulnerability patterns
Why Join Us
- Work on cutting-edge AI projects alongside leading research labs
- Fully remote and flexible — work when and where it suits you
- Freelance autonomy with the structure of meaningful, task-based work
- Your engineering expertise directly shapes how AI understands and generates code at scale
- Intellectually stimulating work that keeps your skills sharp across languages and domains
- Potential for ongoing work and contract extension as new projects launch