Senior AI Platform Engineer

EPAM Systems

Remote · PolandSalary not disclosedfull-timeEPAM Systems Careers (remote abroad)

We are looking for a hands-on AI Platform Engineer to design, build, and maintain the Enterprise Agent Development Platform , a production-grade, cloud-native ecosystem that enables engineering teams to define, orchestrate, deploy, and observe AI agents at scale. The role includes standardizing agent development across the organization, implementing advanced agentic evaluation frameworks (using AWS AgentCore), and building robust LLM-as-a-judge and CI/CD deployment gates to reduce development from months to days while enforcing strict security and quality standards.

Responsibilities

Develop and launch scalable conversational AI systems that operate across multiple channels, including chat, voice, email, and APIs
Architect microservices and asynchronous systems for AI applications, ensuring high availability and performance
Use Python to implement orchestration and decision logic - the control layer that manages tools, workflows, and system interactions
Agentic Evaluation & Quality Gates
Design evaluation frameworks for autonomous agents tracking multi-step workflows, tool-calling accuracy, and session performance, integrating automated gates into CI/CD pipelines
LLM-as-a-Judge & Testing Pipelines: Establish automated evaluation protocols utilizing LLM-as-a-judge patterns
Optimize AI models through fine-tuning and LoRA integration, making data-driven decisions between different approaches (FT vs RAG)
Work with data specialists to design pipelines for collecting, cleaning, and structuring information for AI agents
Design CI/CD pipelines, container standards, and cloud strategies for infrastructure migrations, cost optimization, and high availability

Languages

Work format: Remote
Seniority: Senior
Posted: 29 Sept 2026
Last verified: In the last 5 days

Similar roles

Keep looking

More Software jobs in Armenia and remote All IT vacancies Internships and entry level