Senior ML Engineer (Token Factory)

Responsibilities

• Token Factory is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference & fine-tuning platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to train & deploy at massive scale.
• Inference Optimization: Identifying LLM inference bottlenecks to drive production speedups. This involves building model training and evaluation pipelines in JAX for speculative decoding, experimenting with architectures (dense/MoE, auto-regressive/parallel), and deriving scaling laws to guide resource allocation.
• Strong communication and leadership abilities
• A track record of building and delivering products (not necessarily ML-related) in a dynamic startup-like environment.
• Strong engineering skills, including experience in developing large distributed systems or high-load web services.

Languages