Senior Developer Technology Engineer - Edge Agentic AI

Responsibilities

• Work closely across internal engineering and product teams as well as external app developers and enterprise ISVs on solving local end-to-end agentic AI GPU deployment challenges on NVIDIA RTX & DGX.
• Apply powerful profiling and debugging tools for analyzing most demanding accelerated end-to-end agentic AI workflows to detect insufficient system utilization resulting in suboptimal runtime performance.
• Conduct hands-on trainings, develop sample code and host presentations to give good guidance on efficient end-to-end agentic AI deployment targeting optimal runtime performance.
• Improve LLM & GenAI user experience by working on feature and performance enhancements of OSS software, including but not limited to projects like GGML, Llama.cpp, Ollama, vLLM, ONNX Runtime.
• Collaborate with GPU driver and architecture teams as well as NVIDIA research to influence next generation GPU features by providing real-world workflows and giving feedback on partner and customer needs.
• Providing technical leadership and mentorship to junior engineers, encouraging an inclusive and high-performing team environment.
• What we need to see
• A proven track record 5+ years of professional experience in local GPU deployment, profiling and optimization.
• A Bachelor's or Master's degree or equivalent experience in Computer Science, Engineering, or a related field.
• Strong proficiency in C/C++, Python, software design, programming techniques..

Languages