Become an expert in the health and quality of Facebook's Social and AI products, identifying trends, regressions, and user pain points through data analysis and hands-on product usage Own end-to-end product quality programs for your area, including launches, dogfooding, root cause analyses, incident reviews, and app health regressions automating first and operating with high reliability Design, build, and operate autonomous AI agents and workflows for your product area: bug triage, prioritization, classification, deduplication, and resolution Partner with engineering and product teams to drive resolution of high-priority issues and influence product roadmap based on quality insights Prepare communication materials and progress tracking for multiple audiences including delivering updates to leadership stakeholders Collect, analyze, and leverage data to identify quality trends and inform product decisions; build dashboards and metrics to drive data-driven decision making Build and maintain an evaluation (evals) practice for your area, ensuring AI solutions meet accuracy thresholds through LLM judges, labellers, and governance frameworks Assess and improve existing AI solutions within your scope, driving migration to standard platforms and partnering with AI Implementations leadership on scaling decisions Coordinate with cross-functional teams and Foundations partners to align on org-wide priorities and share best practices Design and operate AI workflows that comply with Facebook data sensitivity guardrails, ensuring quality signals are collected and processed within encryption boundaries and privacy-first constraints