GenAI Algorithms Intern - Model Optimization for Inference

Responsibilities

• Help design and build modular, scalable model optimization software platforms that deliver exceptional user experiences while supporting diverse AI models and optimization techniques.
• Explore, develop, and integrate innovative deep learning optimization algorithms (quantization, speculative decoding, sparsity, distillation, pruning, neural architecture search) into NVIDIA's AI software stack.
• Deploy optimized models into leading open-source inference frameworks and contribute specialized APIs, model-level optimizations, and new features tailored to the latest NVIDIA hardware capabilities.
• Collaborate with NVIDIA teams on model optimization solutions for customer use cases, aiming for optimal end-to-end workflows and balanced accuracy–performance trade-offs.
• Conduct GPU kernel-level profiling to identify and capitalize on hardware and software optimization opportunities (e.g., efficient attention kernels, KV cache optimization, parallelism strategies).
• What we need to see
• Pursuing a Master's or PhD in Computer Science, AI, Applied Math, or a related field.
• Strong deep learning background and hands-on experience with language models.
• Solid foundation in algorithms and programming.
• Proficiency in Python, PyTorch, and modern ML frameworks/tools.

Languages