Software Engineer Intern, AI and DL Kernel Libraries - 2027

Responsibilities

• Contribute to production-quality software that ships as part of NVIDIA's AI software stack, including cuDNN, FlashInfer, and optimized support for large language model inference workloads.
• Help develop new AI systems technologies for efficient inference, with a focus on performance, scalability, maintainability, and usability.
• Support the design, implementation, and optimization of kernels for high-impact AI workloads across LLM inference, generative AI, computer vision, autonomous driving, and recommender systems.
• Assist in building extensible software abstractions for deep learning libraries, LLM serving engines, and runtime systems.
• Contribute to just-in-time compilation, code generation, and runtime technologies for performance-critical GPU workloads.
• Analyze workload performance, tune current software, and help propose improvements to future software and hardware-software interfaces.
• Collaborate closely with engineers across deep learning frameworks, libraries, kernels, compilers, and GPU architecture teams at NVIDIA.
• Contribute to open-source communities and ecosystem integrations where relevant, including projects such as FlashInfer, vLLM, and SGLang.
• What we need to see
• Currently pursuing a Bachelor's, Master's, or PhD degree in Computer Science, Electrical Engineering, or a related field.

Languages