Accountabilities
- Evaluate CVE and application security tasks to determine whether they are technically accurate, realistic, solvable, reproducible, and supported by reliable tests and evaluation criteria.
- Review security scenarios involving vulnerability assessment, secure coding, threat modeling, and application security practices for technical accuracy and practical relevance.
- Assess vulnerability descriptions, exploitation scenarios, expected outcomes, and mitigation approaches to ensure they are logically sound and technically valid.
- Identify security vulnerabilities, exploit execution flaws, mitigation logic errors, and other issues that could compromise task quality or evaluation accuracy.
- Rigorously test and troubleshoot complex security scenarios to validate task behavior, exploitability, remediation logic, and expected results.
- Provide clear, actionable technical feedback on identified security issues and recommend improvements where appropriate.
- Apply specialized application security expertise to ensure AI training and evaluation tasks meet high standards of technical rigor, accuracy, and reproducibility.
- Document technical findings clearly and consistently across assigned project tasks.
Requirements
- Demonstrable professional experience and deep technical knowledge in Application Security, including vulnerability assessment, secure coding practices, and threat modeling.
- Strong understanding of Common Vulnerabilities and Exposures (CVE), application vulnerabilities, exploitation concepts, and security mitigation strategies.
- Strong analytical and problem-solving skills, with the ability to rigorously test, troubleshoot, and evaluate complex technical security scenarios.
- Strong attention to detail and the ability to identify subtle vulnerabilities, exploit execution issues, mitigation weaknesses, and logical inconsistencies.
- Ability to objectively assess technical security tasks against requirements for accuracy, realism, solvability, reproducibility, and reliable evaluation.
- Strong written communication skills for providing precise, constructive, and actionable technical feedback.
- Ability to work independently and apply specialized expertise within a freelance, project-based environment.
- Candidates will be considered for one area of specialization based on their professional experience; expertise across other domains is not required.
- Ability to provide a secure computer and reliable high-speed internet connection for freelance project work.
Benefits
- Compensation of $70–$100 per hour, with the exact rate determined based on experience, expertise, and geographic location.
- Final compensation may vary from the published range following evaluation of your qualifications and location.
- Freelance contract structure offering flexibility for project-based work.
- Remote work environment.
- Opportunity to contribute directly to the training and evaluation of advanced AI systems.
- Opportunity to apply specialized application security expertise to technically challenging AI evaluation projects.
- Health insurance, paid time off, and other company-sponsored employee benefits are not provided under the freelance contract.
- Contractors are responsible for supplying their own secure computer and high-speed internet connection.
Seniority Level:
Not Specified