All vacancies

ML Engineer, Inference and Serving
Armenia · On-siteSalary not disclosedfull-timeFirebird Careers
We are looking for an experienced ML Engineer to help build, deploy, and optimize machine learning systems in production. In this role, you will focus on model serving, inference performance, and scalable deployment of large language models, working closely with platform and infrastructure teams to deliver reliable and efficient AI solutions.
Responsibilities
- Design, deploy, and optimize large language model (LLM) inference systems for production environments
- Evaluate, benchmark, and improve serving performance across latency, throughput, memory utilization, and cost-efficiency metrics
- Implement and optimize model-serving solutions using frameworks such as vLLM, TensorRT-LLM, SGLang, Triton Inference Server, or similar technologies
- Develop and maintain model conversion, deployment, and evaluation workflows across the inference stack
- Apply and validate quantization techniques to improve performance while preserving model quality
- Profile GPU workloads, identify bottlenecks, and drive performance improvements using industry-standard observability and profiling tools
- Collaborate with Platform, Infrastructure, and Product Engineering teams to deploy and operate scalable AI services
- Contribute to architecture decisions related to distributed inference, model serving, caching strategies, and resource utilization
- Improve reliability, monitoring, and operational excellence of production inference systems
- Stay current with emerging advancements in LLM serving, inference optimization, and AI infrastructure technologies, and help evaluate their adoption
Languages
- Work format
- On-site
- Seniority
- Mid
- Posted
- 25 May 2026
- Last verified
- In the last 3 days
Required
- 3+ years ML engineering focused on model deployment and inference, not primarily training or application-layer LLM work.
- Production ownership of at least two of vLLM, SGLang, TensorRT-LLM under real traffic. You have diagnosed and fixed what each one does when it is misconfigured.
- GPU performance diagnosis with Nsight Systems, DCGM, nvidia-smi and engine metrics; can explain a throughput regression from a Grafana board.
- Strong Python; working PyTorch and Hugging Face model formats, tokenizers and chat templates.
Nice to have
- Kubernetes and Helm sufficient to read and edit a variant's rendered deployment.
Firebird
Armenian AI infrastructure company building GPU data centres and a multi-tenant GPU cloud, hiring infrastructure, ML, backend and facility roles in Yerevan and Hrazdan.
- AI infrastructure - data centres and GPU cloud
- Yerevan, Armenia
Other open roles here
- Lead QA / Test Automation EngineerArmenia · On-site
- Monitoring and Observability EngineerArmenia · Hybrid
- Network EngineerArmenia · On-site
- Mechanical Project ManagerArmenia · On-site
- Senior Critical Infrastructure EngineerArmenia · On-site
Similar roles
- ML Engineer (MSc. or PhD)micro1 · Remote · worldwide, UTC+4 accepted
- Junior AI/ML Engineer (GenAI, AWS)Provectus · Remote · Armenia
- Lead AI EngineerEPAM Systems · Remote · Armenia
- Agentic AI EngineerAcba Bank OJSC · Armenia · On-site
- Head of Data Science and Analytics (JetBrains Air)JetBrains · Armenia · Hybrid
- Senior DevOps Engineer (Azure AI / GenAI Solutions)EPAM Systems · Remote · Armenia

