Senior Systems Software Engineer, Workload Systems Engineering

Responsibilities

• Build shared self-service and validation mechanisms that let engineering teams configure and use supported infrastructure workflows with less manual assistance.
• Give customers and on-call teams useful diagnostic views across application, submission, remote-execution, and host or target layers so they can identify where failures and slowdowns originate.
• Set performance and reliability benchmarks for representative workloads. Apply profiling, metrics, traces, and controlled experiments to pinpoint the changes that make a difference.
• Evaluate and improve compute and GPU selection, scheduling and placement, concurrency, worker and runner configuration, resource sharing, caching, and input/output paths.
• Make retry causes, recovery outcomes, and wasted execution capacity visible. Work with component owners to eliminate recurring failures and unnecessary re-execution.
• Implement and validate infrastructure-level changes with application, build and CI, remote-execution, and infrastructure teams. Measure the effect on turnaround, successful efficiency, stability, usable capacity, and cost.
• Turn successful investigations into supported workflows, diagnostics, documentation, and clear customer handoffs.
• What we need to see
• Over 8 years of solid software engineering experience working with production compute infrastructure, distributed systems, large-scale build and test systems, or comparable systems software.
• Hands-on experience debugging complex performance or reliability issues across software and hardware boundaries using logs, metrics, traces, profiling, and experiments.

Languages