Staff Machine Learning Engineer

Responsibilities

• Define and lead the technical vision for Cresta’s next-generation Agentic AI systems, including Agentic Assist and enterprise AI Agents.
• Architect scalable, production-grade LLM systems that integrate reasoning, retrieval, planning, tool use, and real-time decision-making into cohesive, intelligent workflows.
• Design and evolve multi-agent orchestration frameworks that combine RAG, structured knowledge, domain-adapted models, and automated actions.
• Establish best practices for building robust, reliable, and cost-efficient LLM-powered systems in high-scale production environments.
• Own evaluation strategy for complex, non-deterministic AI systems, including offline benchmarking, online experimentation, LLM-as-a-judge methodologies, and systematic failure analysis.
• Proactively identify and mitigate agent failure modes such as hallucinations, tool misuse, retrieval errors, prompt brittleness, context drift, and multi-step reasoning breakdowns.
• Define measurable quality standards (accuracy, faithfulness, task completion, latency, cost efficiency, robustness) and drive continuous system improvement.
• Influence cross-team architecture decisions across ML, backend, and product engineering to ensure seamless integration of AI capabilities.
• Mentor senior engineers, raise the technical bar, and contribute to long-term AI strategy and roadmap planning.
• Translate cutting-edge research advances into practical, high-impact production systems.

Languages