Skip to content
ITA Jobs
All vacancies
NVIDIA logo

Senior Product Manager - AI Platform Inference

NVIDIA

US, CA, Santa Clara · On-site · relocation$14,000–27,313 gross/mofull-timeNVIDIA Careers (offices abroad)

Inference is the fastest growing and most competitive area in Generative AI today. It is where AI models impact our daily life, and where ever bit of accuracy and performance matters for quality, safety, and cost.

Responsibilities

  • Create products to help developers build better Inference deployments
  • Develop product strategy, roadmaps, and go-to-market plans
  • Collaborate with internal and external developers to build product-based roadmaps for model optimization software
  • Work with leadership to align with and drive company strategy
  • What we need to see
  • Experience with Inference deployment and optimization software (ex. vLLM, SGLang, FlashInfer, TensorRT-LLM, Triton, Dynamo, TorchAO, etc.)
  • Demonstrable knowledge of GenAI or machine learning concepts, particularly around performance optimization, and software development and delivery
  • BS or MS degree in Computer Science, Computer Engineering, or similar experience (or equivalent experience)
  • 6+ years of technical product management, or similar, experience at a technology company
  • Strong communication and interpersonal skills

Languages

    Work format
    On-site
    Seniority
    Lead
    Posted
    5 Aug 2026
    Last verified
    In the last 5 days

    Similar roles

    Keep looking