Senior Staff Data Scientist, Consumer Relevance

Responsibilities

• Serve as the technical authority on relevance metrics and evaluation methodology across Consumer, setting standards for how we measure the quality of feeds, search results, and recommendations in a complex, community-driven environment
• Develop metrics frameworks and offline evaluation approaches for ranking and recommendation systems, including proxy metrics that reliably predict long-term outcomes like retention, community health, and user satisfaction
• Design and analyze experiments for relevance features, accounting for challenges unique to networked platforms such as spillover effects between communities, interference between contributors and consumers, and long-run impacts of ranking changes on content supply
• Identify opportunities where improved measurement and analysis can unlock product insights that were previously unmeasurable or ambiguous, particularly around content quality, search intent understanding, and personalization effectiveness
• Partner deeply with ML engineers and product teams to translate model performance metrics into user-facing impact
• Influence the long-term product strategy for Feeds and Search by synthesizing insights from experimentation, observational analysis, and metric deep-dives into clear, actionable recommendations for senior leadership
• Mentor and elevate other data scientists across the organization on relevance evaluation, experimentation best practices for ranking systems, causal reasoning, and statistical rigor
• Publish and share methodological advances internally and, where appropriate, externally to contribute to the broader relevance, recommendation systems, and experimentation community

Languages