Create Career Profile
You can create a Career Profile to get job suggestions, prepare for the interview process, and more.
Create Career ProfileAlready have a Career Profile?
Log in
Advertising TechnologyAR and VRArtificial IntelligenceBusiness Development and PartnershipsCommunications and Public PolicyCreativeData and AnalyticsDesign and User ExperienceEnterprise EngineeringGlobal OperationsInfrastructureLegal, Finance, Facilities and AdministrationPeople and RecruitingProduct ManagementResearchSales and MarketingSecuritySoftware EngineeringTechnical Program ManagementFacebookInstagramMessengerMeta QuestWhatsAppWorkplaceProduction EngineeringPrivacyData Centers
AI Research Scientist, Generative AI Evaluation Foundations, AI Judges team
Location pin icon
London, UK
The Generative AI Evaluation organization’s mission is to measure GenAI models' progress (in particular Llama models) and accelerate the world's AI development. This implies building measurements and methodologies for these assessments. In particular, the AI judges team focuses on building evaluations relying on AI-assistance (e.g., LLM as judges, classifiers), covering a broad spectrum of metrics from helpfulness to safety.
We are looking for a strong AI research scientist, with passion for Generative AI and in particular measurement/assessment of these cutting edge models. You’d join one of our projects and build methods to solve open challenges and unblock the execution and application of AI-assisted measurements to GenAI models, particularly Llama.
We are looking for a team player, who thrives in ambiguity, quickly adapting to new problems and AI metrics from helpfulness to safety; preferred candidates have experience in doing applied research/evaluations on large scale GenAI models.
AI Research Scientist, Generative AI Evaluation Foundations, AI Judges team Responsibilities
- Conduct research on the metrics and methodologies to assess/evaluate GenAI models (in particular Llama models)
- Collaborate with cross-functional teams to ensure that our GenAI models are assessed leveraging state of the art solutions, and potentially co-develop them with partner teams
- Stay up-to-date with the latest developments in the field of Generative AI and their evaluations/AI-assisted evaluation in particular
- Communicate research findings and recommendations to stakeholders and scientific community
Minimum Qualifications
- PhD in the field of Deep learning, Machine Learning, Computer Vision, NLP, Computer Science or a related field.
- Bachelor's degree in Computer Science, Computer Engineering, or a related field
- Experience with conducting research and publishing in top tier peer-reviewed journals and AI conferences
- Excellent communication and collaboration skills
- Ability to work independently and as part of a team
Preferred Qualifications
- Background and/or previous work in Generative AI
- Background and/or previous work in evaluations of GenAI models
- 3+ years of experience after PhD
- Track record of setting technical direction, driving consensus and successful cross-functional partnership
Locations
About Meta
Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.
Meta is committed to providing reasonable support (called accommodations) in our recruiting processes for candidates with disabilities, long term conditions, mental health conditions or sincerely held religious beliefs, or who are neurodivergent or require pregnancy-related support. If you need support, please reach out to accommodations-ext@fb.com.
Related Job Openings
Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, reproductive health decisions, or related medical conditions), sexual orientation, gender identity, gender expression, age, status as a protected veteran, status as an individual with a disability, genetic information, political views or activity, or other applicable legally protected characteristics. You may view our Equal Employment Opportunity notice here. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. We may use your information to maintain the safety and security of Meta, its employees, and others as required or permitted by law. You may view Meta Pay Transparency Policy, Equal Employment Opportunity is the Law notice, and Notice to Applicants for Employment and Employees by clicking on their corresponding links. Additionally, Meta participates in the E-Verify program in certain locations, as required by law.
Meta is committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at accommodations-ext@fb.com.
© Meta 2024
Our policies
More resources