Senior Manager, Training Data

Responsibilities

• Own the product vision, strategy, and roadmap for training data acquisition and preparation.
• Translate research priorities and model capability gaps into source requirements, platform investments, and dataset acceptance criteria aligned with training schedules.
• Define requirements for source discovery, URL indexing, predictive quality and diversity ranking, crawl scheduling, distributed fetching, and ingestion.
• Partner with engineering on throughput, reliability, storage, and capacity planning as workloads scale.
• Drive improvements in parsing and curation, including HTML extraction, browser-rendered content, code and math preservation, duplication, quality filtering, and dataset composition.
• Identify where valuable content is lost and increase the yield of usable, differentiated data.
• Lead build, buy, and partner decisions across internal crawling, commercial datasets, and licensed content. Establish comparable internal and vendor pilots that measure incremental coverage, accepted data yield, delivery reliability, and total cost against existing corpora.
• Partner with researchers on controlled training experiments and ablations to measure data impact on model capabilities. Account for benchmark contamination, dataset composition, and regressions, and use results to guide source selection and acquisition investment.
• Work with legal, privacy, policy, and security teams to translate approved requirements into scalable controls for source eligibility, access restrictions, opt-outs, provenance, and permitted use. Define auditable dataset acceptance and release processes.
• Build researcher-facing capabilities for dataset discovery, metadata, versioning, lineage, and quality reporting. Enable reproducible dataset releases and reuse, measure adoption, and reduce the time from a research request to training-ready data.

Languages