• *About The Job • *Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include • *Benchmark , • *General Catalyst , • *Peter Thiel , • *Adam D'Angelo , • *Larry Summers , and • *Jack Dorsey . • *Position Chemistry AI Evaluator • *Type • *Contract • Compensation • $73/hour • *Location • *Remote • *Role Responsibilities • Write and refine prompts to guide model behavior in chemistry contexts. • Evaluate LLM-generated responses to chemistry-related queries for scientific accuracy and quantitative reasoning. • Conduct fact-checking using authoritative public sources and domain knowledge. • Annotate model responses by identifying strengths, areas of improvement, and inaccuracies. • Assess clarity, structure, and appropriateness of explanations for different audiences. • Apply consistent evaluation standards by following clear taxonomies and benchmarks. • *Qualifications • *Must-Have • PhD in Chemistry or a closely related field • Deep expertise in Organic & Biological Chemistry, Inorganic & Materials Chemistry, Physical & Theoretical Chemistry, or Analytical & Instrumental Chemistry • Significant experience using large language models (LLMs) • Excellent writing skills and strong attention to detail • Experience reviewing or editing technical or academic writing • *Preferred • Prior experience with RLHF, model evaluation, or data annotation work • Experience teaching or explaining chemistry concepts to non-expert audiences • Familiarity with evaluation rubrics or structured review frameworks • *Application Process (Takes 20–30 mins to complete) • Upload resume • AI interview based on your resume • Submit form • Resources & Support • For details about the interview process and platform information, please check https//talent.docs.mercor.com/welcome/welcome • For any help or support, reach out to
[email protected] • PS Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity. , Apply To this Job