Lead Azure DevOps Engineer

Responsibilities

• Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
• Integrate models and providers into gateway solutions to support enterprise-scale operations
• Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
• Establish observability and resilience mechanisms to maintain production stability
• Implement LLM routing and broker logic to optimize model performance and reliability
• Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
• Take ownership of gateway implementation projects and deliver functional solutions rapidly
• Collaborate with cross-functional teams to align gateway operations with organizational security standards
• Monitor and troubleshoot production systems to ensure continuous availability

Languages

Required

• 5+ years of hands-on engineering experience with AI/LLM gateway technologies, including deployment, integration, and production operations
• Expertise in Azure API Management, Azure DevOps, and Azure AI Content Safety
• Skills in observability, resilience engineering, and production system operations

Nice to have

• English proficiency at B2 level or higher

Other open roles here

• Senior/Lead Power BI Software EngineerRemote · Ukraine
• Delivery Manager (AI Native)Remote · Ukraine
• Senior Financial Manager (m/f/d)Remote · Germany
• Principal, Business ConsultingRemote · United States
• Senior Delivery Manager - .NET/JavaIndia · On-site · relocation