Site Reliability Engineer, Provider Operations

Responsibilities

• Provider health and observability.
• Build and own monitoring for every provider and endpoint: latency, throughput, error rates, uptime, and output correctness.
• Set SLOs per provider tier and alert on them.
• Detection and failover. Improve how quickly we detect degraded endpoints, and work with the routing team so traffic shifts away from them automatically.
• Incident response.
• Own on-call for provider incidents: triage, mitigate, communicate with providers, run postmortems, and drive follow-ups to closure.
• Provider accountability. Turn telemetry into scorecards and SLO reporting that providers act on, and be the technical escalation point when a provider's endpoint is misbehaving.
• Quality regression detection.
• Build continuous canaries and evals that catch silent regressions (quantization changes, broken tool calling, truncated streams, pricing or usage-reporting mismatches), not just outright downtime.
• Automate the toil. Replace manual provider-ops work (disabling endpoints, capacity changes, deprecations, rate-limit tuning) with safe, auditable tooling.

Languages