Principal AI Solution Engineer

Responsibilities

• Set architecture for systems that span squads; write the decision down and defend it
• Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
• Own the reference RAG and agent architecture other teams build against
• Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
• Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind

Languages