Lead Azure DevOps Engineer

Responsibilities

• Deploy and manage AI/LLM gateway technologies such as LiteLLM, Citadel, or Azure APIM AI Gateway
• Integrate models and providers into gateway solutions to support enterprise-scale operations
• Configure routing, policy enforcement, and token/rate controls across gateway infrastructure
• Establish observability and resilience mechanisms to maintain production stability
• Implement LLM routing and broker logic to optimize model performance and reliability
• Enforce enterprise policies, including PII detection and redaction, to ensure compliance and security
• Take ownership of gateway implementation projects and deliver functional solutions rapidly
• Collaborate with cross-functional teams to align gateway operations with organizational security standards
• Monitor and troubleshoot production systems to ensure continuous availability

Languages