Compute System Arch Engineer, AI Infra - New College Grad 2027

Responsibilities

• Design and develop reusable AI platform components and services that provide consistent interfaces for model access, knowledge retrieval, tool calling, and workflow execution.
• Build data ingestion and processing pipelines for heterogeneous sources, including documents, code, and tables, supporting parsing, structured extraction, incremental updates, versioning, and provenance.
• Develop retrieval-augmented generation (RAG) and knowledge infrastructure, combining vector search, keyword search, reranking, and structured knowledge to improve retrieval quality and context relevance.
• Develop agentic and multi-agent workflows with tool integration, context and state management, task scheduling, failure recovery, and human review.
• Build evaluation and observability systems using datasets, automated tests, regression benchmarks, and execution traces to measure and improve correctness, reliability, latency, and cost.
• Own platform deployment and maintenance, including access controls, data isolation, recovery mechanisms, and release processes, supporting reliable use across multiple users and applications.
• Collaborate with domain experts and application developers to translate engineering needs into platform capabilities and continuously improve them through user feedback.
• What we need to see
• Bachelor’s degree in Computer Science, Software Engineering, Electrical Engineering, or a related field, or equivalent experience. An MS or PhD is a plus.
• Hands on experience in software engineering, infrastructure, data platforms, machine learning engineering, or related areas.

Languages