Lead AI Platform Engineer

EPAM Systems

Remote · ArmeniaSalary not disclosedcontractVerified recentlyEPAM Systems Careers

We are seeking a Lead AI Platform Engineer to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment. This role owns the end-to-end architecture covering MCP (Model Context Protocol), agents, multi-provider LLM integrations, authentication and authorization, semantic caching, rate limiting, guardrails and reusable frameworks for agent and tool development.

Responsibilities

Develop the AI Gateway platform, including MCP, agents, LLM routing, governance and observability
Translate business and product requirements into clear problem statements, architectural designs and scalable technical solutions
Design extensible frameworks for MCP server capabilities and integrations as well as agent orchestration and reusable agent skills Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas and traffic governance and guardrails and validation layers for safe LLM/MCP usage
Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation and token-based access control for MCP and LLM traffic
Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices and integration patterns Review designs and code, providing actionable feedback to ensure quality, performance, scalability and security Define and review CI/CD best practices using modern GitHub-based…

Languages

Work format: Remote
Seniority: Lead
Posted: 27 Jul 2026 (1mo ago)
Last verified: 28 Aug 2026

Keep looking

More Software jobs in Armenia All IT vacancies Internships and entry level

Loading…

Responsibilities

Develop the AI Gateway platform, including MCP, agents, LLM routing, governance and observability

Translate business and product requirements into clear problem statements, architectural designs and scalable technical solutions

Design extensible frameworks for MCP server capabilities and integrations as well as agent orchestration and reusable agent skills Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas and traffic governance and guardrails and validation layers for safe LLM/MCP usage

Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation and token-based access control for MCP and LLM traffic

Build prototypes and reference implementations to validate architectural decisions and guide engineering teams

Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices and integration patterns Review designs and code, providing actionable feedback to ensure quality, performance, scalability and security Define and review CI/CD best practices using modern GitHub-based…