Generative AI Operations Engineer (GenAI Ops)

Responsibilities

• Manage CI/CD Pipelines
• Design, implement, and maintain robust, automated CI/CD pipelines for training, evaluating, and deploying large language models (LLMs) and AI agents
• Orchestrate Agentic AI Workflows
• Design, deploy, and manage sophisticated, multi-agent systems. Ensure seamless Agent-to-Agent (A2A) communication and collaboration between specialized agents to automate complex business processes
• Manage Tool Integration
• Implement and manage secure, scalable integrations between AI agents and external tools/APIs, leveraging open standards like the Model Context Protocol (MCP) to ensure interoperability
• Leverage AI-Powered Development: Utilize AI-powered development tools to accelerate the entire software development lifecycle, from writing infrastructure code and tests to troubleshooting operational issues in cloud environments
• Infrastructure as Code (IaC): Utilize cloud-native IaC services or cloud-agnostic tools like Terraform to define and manage the infrastructure required for GenAI workloads
• Model Monitoring and Observability
• Implement comprehensive monitoring and logging solutions to track model and agent performance, resource utilization, and system health. For agentic systems, this includes tracing the agent's actions and logging the multi-step conversational flow

Languages