Sr. Observability Systems Engineer

Responsibilities

• Technical Leadership
• Set technical direction and standards for observability across the organization, including instrumentation conventions, alerting philosophy, and dashboard design patterns.
• Mentor engineers on the Observability team and act as a technical resource for SRE, Storage Engineering, and Network Engineering on observability practice.
• Lead design reviews for observability work and represent the team in cross-functional architecture discussions.
• Evaluate build-versus-buy decisions for observability and AIOps tooling, including data sovereignty and compliance considerations.
• Produce and maintain design documentation, runbooks, and architectural decision records that make the platform operable and extensible by future contributors.
• Observability Platform
• Own and evolve our metrics pipeline, including VictoriaMetrics, Prometheus, and the Consul-based service discovery layer that keeps scrape targets current as infrastructure scales.
• Own and expand our logging stack (OpenSearch, Logstash, and Filebeat) across all Backblaze data centers.
• Architect and expand distributed tracing with Jaeger and OpenTelemetry, extending coverage beyond the current application instrumentation to new services.

Languages