Developer Technology Engineering Intern - 2027

Responsibilities

• Working directly with key application developers to understand the current and future problems they are solving. You will build and optimize core parallel algorithms and data structures to deliver the most effective solutions using GPUs, through both library development and direct contribution to applications. This…
• Collaborating closely with the architecture, research, libraries, tools, and system software teams at NVIDIA to influence the build of next-generation architectures, software platforms, and programming models. This includes investigating impact on application performance and developer efficiency, and turning real-world…
• Engaging in deep optimization of high-performance operators, involving but not limited to GPU kernel optimization, instruction-level tuning, and compiler optimization. These optimizations will directly support customers or be coordinated within computation libraries and open-source projects across the community, like…
• Improving communication for broad distributed large language models workloads. You will spearhead advancements in distributed training and inference by refining communication libraries(NCCL,NCCL GIN , NVSHMEM) and engaging in open-source communication libraries(like DeepEP, NCCL EP). This demands in-depth study of…
• What we need to see
• A degree or equivalent experience from a university in an engineering or computer science related field. A masters or doctoral candidate is preferred.
• Solid understanding of C, C++, Python, or Fortran.
• Strong knowledge of software development, programming techniques, and algorithms.
• Strong mathematical fundamentals, including linear algebra and numerical methods.
• Background in parallel programming and accelerated computing, with comprehensive knowledge of parallel architectures and methods for performance analysis and tuning. Experience in GPU programming is desirable.

Languages