About the Role

This is a 12-month contract role as a Domain Expert Lead in STEM, focusing on advancing AI model training and evaluation. The position involves analyzing LLM responses, developing data quality benchmarks, and collaborating with AI research teams to improve model capabilities. The role requires domain expertise in STEM fields to ensure data integrity and quality standards.

Key Responsibilities

• Critically analyze and evaluate responses generated by LLMs across various domains
• Develop and write demonstrations to illustrate quality data benchmarks
• Participate in creating tooling for data creation by providing feedback
• Champion knowledge-sharing initiatives and cultivate strategic partnerships across teams
• Provide detailed feedback to refine and improve LLM understanding and output

Required Skills & Qualifications

Must Have:

• Master's degree in science, technology, engineering, or mathematics (STEM)
• 1+ years of experience creating or contributing to mathematical textbooks, research papers, or educational content

Nice to Have:

• PhD in science, technology, engineering, or mathematics (STEM)
• 1+ years of experience working with or evaluating AI systems
• Understanding of machine learning concepts, particularly as they apply to reasoning and problem-solving
• Strong analytical and decision-making skills in abstract and theoretical contexts
• Excellent written and verbal communication skills for explaining complex concepts

Benefits & Perks

• Medical benefits
• Financial benefits
• Other benefits as part of total compensation package
• Workplace accommodations for disabilities