Cyber Evaluations Engineer

Responsibilities

• Design and run capability, uplift, and safety evaluations to assess cyber-relevant risk in new models
• Execute per-release safeguard-robustness testing ahead of major model launches
• Analyze evaluation results and communicate findings clearly to the team and to stakeholders
• Design, prototype, and tune detection probes for cyber misuse
• Work with the cyber policy team to turn policy lines into a layered, robust abuse-detection architecture, and measure its precision and coverage over time
• Build and maintain internal tooling used to run and score evaluations
• Collaborate with policy and engineering partners to translate eval findings into safeguard improvements

Languages