Own the evidence standard for Health GenAI launches: define the readiness bar, produce the evidence package behind each launch decision, and serve as the scientific authority that decision rests on. Define and lead the evaluation strategy for GenAI health products, establishing what “good,” “safe,” and “ready to ship” mean, and the evidence required to claim each. Design and build LLM and multimodal benchmarks for health: clinical reasoning, factuality and hallucination, safety and harm avoidance, appropriate escalation and refusal, calibration and uncertainty, and fairness across populations.
Develop clinical confirmation methodology, pairing automated evaluations with clinician-in-the-loop adjudication, inter-rater reliability, and study designs that produce defensible evidence. Partner with product and AI engineering from concept through launch of Meta's Health GenAI features, defining the claim, the evidence, and the guardrails before the feature exists. Partner with clinical research, regulatory, and legal to align evaluation evidence with submission and documentation needs where products are on a regulated path.
Define new research directions in health AI evaluation where no established methodology exists, and publish work that shapes how the field measures clinical generative AI. Set technical direction across teams, raise the scientific bar through review and mentorship, and represent Meta's position on Health AI evaluation externally through publication, benchmarks, and standards work. Generates entirely new research directions, works on problems of the highest complexity and ambiguity, and makes technical contributions likely to reshape how the field thinks about the area.