AI Solution/Principal Engineer

Responsibilities

• Set evaluation strategy: what gets measured, at which layer, with what methodology, and how results feed product decisions
• Build the shared platform, including evaluation harnesses, golden-set management, dataset versioning, automated grading, regression detection, and reporting leadership can read
• Make grading trustworthy through judge model selection, rubric design, calibration against human labels, and knowing when automated grading cannot be trusted
• Evaluate retrieval and agents for grounding and citation correctness, tool-use validation, multi-step reasoning and failure recovery
• Develop Arabic golden sets and judges calibrated for Arabic rather than assumed to transfer from English
• Run online evaluation and drift detection
• Conduct prompt injection, jailbreak and data-leakage red-teaming
• Wire evaluation and test automation together as quality gates in CI/CD

Languages