Position:
Bilingual German Generalist Evaluator Expert
Type:
Hourly Contract
Compensation:
$25–$30/hour
Location:
Remote
Commitment:
20+ hours/week | ~2+ months
Role Responsibilities
• Create detailed German and/or English prompts with multiple constraints and clear instructions, ensuring natural phrasing and real-world relevance for German-speaking users.
• Develop high-quality German/English prompt and golden answer pairs to train and evaluate advanced language models.
• Establish evaluation standards and comprehensive rubrics aligned with German linguistic nuance, tone, and cultural context.
• Run prompts through AI models and assess outputs for accuracy, fluency, and cultural alignment in German, comparing with English where required.
• Collaborate in QA review processes to ensure consistency, rigor, and reliability across German-language benchmarks.
• Deliver high-quality written work within structured timelines and project guidelines.
Requirements
• Native-level fluency in written German with strong reading and writing proficiency in English.
• BS or BA from a reputable institution (completed or in progress).
• Strong writing, analytical, and critical thinking skills.
• Ability to work independently and meet deadlines in a remote environmentSignificant familiarity with ChatGPT or similar AI tools.
• Able to reliably produce culturally accurate, Germany-specific German content.
Application Process
• Upload resume
• Interview
• Submit form
Apply tot his job
Apply To this Job