Application Developer | $80/hr Remote
Posted Today by Crossing Hurdles
Negotiable
Undetermined
Remote
United Kingdom
Summary: The role of Software Engineering & Systems Design Expert involves evaluating LLM-generated responses to software engineering questions for accuracy and completeness. The expert will review technical explanations, execute code tests, and provide structured feedback on model outputs. This position requires significant experience in software engineering and a strong understanding of programming languages. The role is remote and offers flexible hours between 10 to 40 per week.
Key Responsibilities:
- Evaluate LLM-generated responses to software engineering and coding questions for accuracy, reasoning quality, and completeness.
- Review and validate technical explanations, system design discussions, and code solutions across varying complexity levels.
- Execute and test code to verify correctness, performance, and edge-case handling.
- Identify logical errors, inefficiencies, bugs, or misleading explanations in model-generated outputs.
- Annotate responses with structured feedback highlighting strengths, weaknesses, and factual inaccuracies.
- Assess code quality, readability, algorithmic soundness, and adherence to engineering best practices.
- Ensure AI outputs align with expected conversational behavior and system guidelines.
- Apply consistent evaluation standards using defined taxonomies, benchmarks, and review criteria.
Key Skills:
- BS, MS, or PhD in Computer Science or a closely related technical field.
- Significant real-world experience in software engineering or systems design roles.
- Expertise in at least one major programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).
- Ability to independently solve medium to hard-level algorithmic problems.
- Experience contributing to open-source projects with merged pull requests.
- Strong familiarity with using LLMs for coding and understanding their strengths and limitations.
- Excellent attention to detail and ability to evaluate complex technical reasoning.
- Fluent in English with strong written communication skills.
Salary (Rate): £80.00/hr
City: undetermined
Country: United Kingdom
Working Arrangements: remote
IR35 Status: undetermined
Seniority Level: undetermined
Industry: IT
Position: Software Engineering & Systems Design Expert
Type: Hourly contract
Compensation: $45–$80/hour
Location: Remote
Commitment: 10–40 hours/week
Role Responsibilities
- Evaluate LLM-generated responses to software engineering and coding questions for accuracy, reasoning quality, and completeness.
- Review and validate technical explanations, system design discussions, and code solutions across varying complexity levels.
- Execute and test code to verify correctness, performance, and edge-case handling.
- Identify logical errors, inefficiencies, bugs, or misleading explanations in model-generated outputs.
- Annotate responses with structured feedback highlighting strengths, weaknesses, and factual inaccuracies.
- Assess code quality, readability, algorithmic soundness, and adherence to engineering best practices.
- Ensure AI outputs align with expected conversational behavior and system guidelines.
- Apply consistent evaluation standards using defined taxonomies, benchmarks, and review criteria.
Requirements
- BS, MS, or PhD in Computer Science or a closely related technical field.
- Significant real-world experience in software engineering or systems design roles.
- Expertise in at least one major programming language (e.g., Python, Java, C++, JavaScript, Go, Rust).
- Ability to independently solve medium to hard-level algorithmic problems.
- Experience contributing to open-source projects with merged pull requests.
- Strong familiarity with using LLMs for coding and understanding their strengths and limitations.
- Excellent attention to detail and ability to evaluate complex technical reasoning.
- Fluent in English with strong written communication skills.
Application Process (Takes 20 Min)
- Upload resume
- Interview (15 min)
- Submit form