Performance Software Intern, Deep Learning Libraries - 2027

Responsibilities

• Writing highly tuned compute kernels to perform core deep learning operations (e.g. matrix multiplies, MoE, Attention)
• Following general software engineering best practices including support for regression testing and CI/CD flows
• Collaborating with teams across NVIDIA
• Compiler team on generating optimal assembly code
• Deep learning training and inference performance teams on which layers require optimization
• Hardware and architecture teams on the programming model for new deep learning hardware features
• What we need to see
• Pursuing Masters or PhD degree in Computer Science, Computer Engineering, Applied Math, or related field
• Demonstrated strong programming and software design skills, including debugging, performance analysis, and test design
• Experience with performance-oriented parallel programming, even if it’s not on GPUs (e.g. with OpenMP or pthreads)

Languages