Skip to content
ITA Jobs
All vacancies
Firebird logo

ML Engineer, Inference and Serving

Firebird

Armenia · On-siteSalary not disclosedfull-timeFirebird Careers

We are looking for an experienced ML Engineer to help build, deploy, and optimize machine learning systems in production. In this role, you will focus on model serving, inference performance, and scalable deployment of large language models, working closely with platform and infrastructure teams to deliver reliable and efficient AI solutions.

Responsibilities

  • Design, deploy, and optimize large language model (LLM) inference systems for production environments
  • Evaluate, benchmark, and improve serving performance across latency, throughput, memory utilization, and cost-efficiency metrics
  • Implement and optimize model-serving solutions using frameworks such as vLLM, TensorRT-LLM, SGLang, Triton Inference Server, or similar technologies
  • Develop and maintain model conversion, deployment, and evaluation workflows across the inference stack
  • Apply and validate quantization techniques to improve performance while preserving model quality
  • Profile GPU workloads, identify bottlenecks, and drive performance improvements using industry-standard observability and profiling tools
  • Collaborate with Platform, Infrastructure, and Product Engineering teams to deploy and operate scalable AI services
  • Contribute to architecture decisions related to distributed inference, model serving, caching strategies, and resource utilization
  • Improve reliability, monitoring, and operational excellence of production inference systems
  • Stay current with emerging advancements in LLM serving, inference optimization, and AI infrastructure technologies, and help evaluate their adoption

Languages

    Work format
    On-site
    Seniority
    Mid
    Posted
    25 May 2026
    Last verified
    In the last 3 days

    Similar roles

    Keep looking