Senior AI Engineer, MCP

EPAM Systems

Remote · ArmeniaSalary not disclosedcontractVerified recentlyEPAM Systems Careers

We are seeking a Senior AI Engineer, MCP to lead the design and evolution of a next-generation AI Gateway platform that enables secure, scalable, and governed access to Large Language Models (LLMs) and agentic workflows across the enterprise in a SAAS environment. This role owns the end-to-end architecture covering MCP (Model Context Protocol), agents, multi-provider LLM integrations, authentication and authorization, semantic caching, rate limiting, guardrails, and reusable frameworks for agent and tool development.

Responsibilities

Develop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observability
Translate business and product requirements into clear problem statements, architectural designs, and scalable technical solutions
Design extensible frameworks for MCP server capabilities and integrations, as well as agent orchestration and reusable agent skills Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas, and traffic governance
Build guardrails and validation layers for safe LLM/MCP usage
Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic
Build prototypes and reference implementations to validate architectural decisions and guide engineering teams
Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices, and integration patterns Review designs and code, providing actionable feedback to ensure quality, performance, scalability, and security Define and review CI/CD best practices using modern GitHub-based…

Languages

Work format: Remote
Seniority: Senior
Posted: 30 Jul 2026 (4w ago)
Last verified: 28 Aug 2026

Keep looking

More Data & AI jobs in Armenia All IT vacancies Internships and entry level

Loading…

Responsibilities

Develop the AI Gateway platform, including MCP, agents, LLM routing, governance, and observability

Translate business and product requirements into clear problem statements, architectural designs, and scalable technical solutions

Design extensible frameworks for MCP server capabilities and integrations, as well as agent orchestration and reusable agent skills Architect gateway capabilities such as semantic caching for LLM responses, rate limiting, quotas, and traffic governance

Build guardrails and validation layers for safe LLM/MCP usage

Design and review authentication and authorization models, including multiple OIDC-based flows, identity propagation, and token-based access control for MCP and LLM traffic

Build prototypes and reference implementations to validate architectural decisions and guide engineering teams

Partner with multiple product teams integrating with the AI Gateway, providing architecture guidance, best practices, and integration patterns Review designs and code, providing actionable feedback to ensure quality, performance, scalability, and security Define and review CI/CD best practices using modern GitHub-based…