Skip to content
ITA Jobs
All vacancies
NVIDIA logo

Senior AI-Native Systems Software Engineer, TensorRT

NVIDIA

US, CA, Santa Clara · On-site · relocation$12,667–23,958 gross/mofull-timeNVIDIA Careers (offices abroad)

Are you passionate about redefining how software is built in the age of Generative AI? Join NVIDIA’s TensorRT team to help lead a first-of-its-kind, AI-native initiative designed to make TensorRT the default entry point for out-of-framework inference globally.

Responsibilities

  • Architecting an AI-native framework: Help design and build a codebase and architecture that scales beyond human capacity, supporting large numbers of AI agents working in parallel to generate, test, and validate production-grade software.
  • Scaling through agentic workflows: Improve the ratio of compute-to-software output by adopting and building AI-native tools, multi-agent orchestrators, and codebase harnesses that keep humans focused on the highest-value work..
  • Rapid prototyping with SOTA models
  • Act as a technical scout, identifying industry and academic breakthroughs (e.g., new attention mechanisms, KV cache strategies) and dispatching AI agent swarms to prototype and integrate these capabilities into our framework.
  • Delivering a great user experience: Ensure a seamless, high-performance path to production for the latest model families (LLMs, Diffusion, Audio, Vision and multi-modal models).
  • Extreme performance optimization: Work at the intersection of Python orchestration and C++ engine-level optimizations to achieve major latency and throughput gains for critical customer use cases.
  • What we need to see
  • BS, MS, or PhD in Computer Science, Computer Engineering, AI, or equivalent experience.
  • 4+ years of relevant software development experience.
  • Strong modern C++ skills: Proficiency with C++11/14/17 (or newer) and the STL, with an emphasis on clean, maintainable, performant code.

Languages

    Work format
    On-site
    Seniority
    Senior
    Posted
    30 Oct 2026
    Last verified
    In the last 5 days

    Similar roles

    Keep looking