Position:
AI Evaluation Specialist
Type:
Contract
Compensation:
$22 - $70/hour
Location:
Remote
Commitment:
10-40 hrs/week
Role Responsibilities
• Review and critically assess AI-generated outputs for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content types and visual experiences.
• Apply structured evaluation guidelines and provide insightful, nuanced feedback to inform model improvements.
• Collaborate with cross-functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations, ensuring reliable and actionable results.
• Contribute to the continuous enhancement of evaluation workflows and best practices.
Requirements
• Have native English proficiency at C1 or C2 level.
• Possess exceptional reading comprehension and acute attention to detail.
• Demonstrate strong observational skills with excellent aesthetic or editorial judgment.
• Be able to think critically and deliver consistent, high-quality evaluations in ambiguous scenarios.
• Have excellent written and verbal communication skills.
Application Process
• Easy Apply on LinkedIn
• Check email for next steps
• Participate in resume evaluation & interview stage
Apply tot his job
Apply To this Job