All vacancies
Principal Architect, AI Inference Networking - NIXL and Dynamo
NVIDIA
China, Shanghai +1 more · On-site · relocationSalary not disclosedfull-timeNVIDIA Careers (offices abroad)
China is where some of the world's most demanding inference deployments are being built. We are hiring a senior architect to work directly with the platform teams building them, understanding what breaks at scale and turning that into upstream code and roadmap.
Responsibilities
- Drive NIXL adoption in China, from the first architecture conversation through prototype and benchmark to production rollout and upstream contribution.
- Profile customer inference stacks and fix what's costing throughput and TTFT: KV cache movement, memory registration, transfer scheduling.
- Write NIXL backends and plugins, extend Dynamo integrations, and contribute optimizations upstream to NIXL and GPUDirect class data paths.
- Help define the APIs that make the data path dynamic, supporting elastic scaling, worker churn and runtime rerouting in production inference clusters.
- Bring the region's requirements into NVIDIA's roadmap with enough technical authority to change it.
- Grow the local community around NIXL through talks, benchmarks and reference architectures.
- What we need to see
- M.Sc. or Ph.D. in CS/EE/CE, or equivalent depth earned in industry.
- 12+ years building or optimizing large scale distributed systems: AI inference or training infrastructure, communication libraries, high performance networking, or HPC runtimes.
- Strong systems programming in C++ and Python, with performance critical code shipped.
Languages
- Work format
- On-site
- Seniority
- Lead
- Posted
- 23 Sept 2026
- Last verified
- In the last 5 days
Similar roles
- Connectivity Engineer (Crypto)Taraki · Remote · worldwide, UTC+4 accepted
- Lead HPC EngineerEPAM Systems · Remote · Armenia
- ASIC Digital Design, Sr EngineerSynopsys · Armenia · On-site
- Senior Full Stack EngineerCredo · Remote · worldwide, UTC+4 accepted
- Lead AI Python EngineerEPAM Systems · Remote · Armenia
- Backend Developer (Node) Part-timeZoftify - Travel Software Development · Remote · worldwide, UTC+4 accepted

