Generative AI Operations Engineer (GenAI Ops)

Responsibilities

• Manage CI/CD Pipelines
• Design, implement, and maintain robust, automated CI/CD pipelines for training, evaluating, and deploying large language models (LLMs) and AI agents Orchestrate Agentic AI Workflows
• Design, deploy, and manage sophisticated, multi-agent systems. Ensure seamless Agent-to-Agent (A2A) communication and collaboration between specialized agents to automate complex business processes
• Manage Tool Integration
• Implement and manage secure, scalable integrations between AI agents and external tools/APIs, leveraging open standards like the Model Context Protocol (MCP) to ensure interoperability Leverage AI-Powered Development: Utilize AI-powered development tools to accelerate the entire software development lifecycle, from…
• Implement comprehensive monitoring and logging solutions to track model and agent performance, resource utilization, and system health. For agentic systems, this includes tracing the agent's actions and logging the multi-step conversational flow Scalability and Performance Optimization
• Design and implement scalable architectures for model serving and inference. Continuously optimize the performance and cost-effectiveness of our GenAI services Security and Compliance
• Implement and enforce security best practices for our GenAI infrastructure and data. Ensure compliance with industry standards and regulations

Languages