All vacancies
Senior ML Solutions Architect - Token Factory
Nebius
Remote · worldwide, UTC+4 acceptedSalary not disclosedfull-timeVerified recentlyHimalayas
This position sits within Nebius Token Factory, our serverless platform for running and customizing open-source LLMs in production. Token Factory allows for serverless inference and fine-tuning (LoRA, full FT, RFT) backed by in-house optimizations like custom speculative decoding, quantization, cache-aware routing and dedicated endpoints.
Responsibilities
- Optimize LLM inference across various modalities to drive business value and support customer goals
- Provide support in supervised and reinforcement learning fine-tuning to maximize model quality for the customers
- Design and implement LLM-based solutions using Nebius Token Factory’s inference services
- Build production-ready applications leveraging our serverless LLM APIs, including multimodal models (text, vision, audio) and domain-specific models
- Provide technical expertise in prompt engineering, RAG architectures and model selection
- Collaborate with product and engineering teams to surface customer feedback and shape the platform roadmap
- Guide customers in scaling from POC to production with a focus on performance, reliability, and cost efficiency
Languages
- Work format
- Remote
- Seniority
- Senior
- Posted
- 16 Sept 2026 (4 days ago)
- Last verified
- 20 Sept 2026
- Apply by
- 15 Nov 2026