The Generative AI Evaluation organization’s mission is to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI judges team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers), covering a broad spectrum of metrics from helpfulness to safety. We are looking for a strong AI research scientist, with passion for Generative AI and in particular measurement/assessment of these cutting edge models. You’d join one of our projects and build methods to solve open challenges and unblock the execution and application of AI-assisted measurements to GenAI models, particularly Llama. We are looking for a team player, who thrives in ambiguity, quickly adapting to new problems and AI metrics from helpfulness to safety; preferred candidates have experience in doing applied research/evaluations on large scale GenAI models.