Skip to content
ITA Jobs
All vacancies
Cohere logo

Senior ML Systems Engineer, Frameworks & Tooling

Cohere

Remote · United Kingdom, FranceSalary not disclosedfull-timeCohere Careers

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

Responsibilities

  • Build and own the training framework responsible for large-scale LLM training.
  • Design distributed training abstractions (data/tensor/pipeline parallelism, FSDP/ZeRO strategies, memory management, checkpointing).
  • Improve training throughput and stability on multi-node clusters (e.g., GB200/300, AMD, H200/100).
  • Develop and maintain tooling for monitoring, logging, debugging, and developer ergonomics.
  • Collaborate closely with infra teams to ensure our cluster, container environments, and hardware configurations support high-performance training.
  • Investigate and resolve performance bottlenecks across the ML systems stack.
  • Build robust systems that ensure reproducible, debuggable, large-scale runs.

Languages

    Work format
    Remote
    Seniority
    Senior
    Posted
    1 Dec 2025
    Last verified
    In the last 5 days

    Similar roles

    Keep looking