Principal Product Manager, AI Gateway

Responsibilities

• Own product strategy and prioritization. Define the vision, roadmap, and success measures for the gateway, balancing developer adoption with enterprise requirements.
• Understand developers and enterprise customers. Work directly with developers, AI teams, platform engineers, and security stakeholders to uncover needs, validate solutions, and guide investment.
• Make secure onboarding simple. Improve the journey from launching a sandbox and authenticating to connecting an agent, selecting a model, and completing the first useful task.
• Build a cohesive developer experience.
• Partner with engineering and design on APIs, CLI tools, administration experiences, documentation, and integrations with AI coding tools.
• Shape model access and interoperability. Work directly with inference providers to evaluate model capabilities, plan integrations, and align on capacity, reliability, and pricing. Prioritize model discovery and compatibility so customers can adopt new models without unnecessary integration work.
• Define enterprise safety and governance experiences.
• Translate requirements for identity, access management, credential protection, policy enforcement, and auditability into clear, usable capabilities.
• Guide reliability and cost-management decisions. Define traffic balancing, routing, and fallback strategies across multiple inference providers, balancing model quality, latency, availability, and cost.
• Own inference cost-management priorities, including usage visibility, budgets, and spend optimization.

Languages