Test Lead (AI Validation & Integration)

Responsibilities

• Strategy & Planning
• Own the QA Strategy
• Design, plan and dDevelop the comprehensive Testing and AI Validation Strategy, covering FunctionalUnit, E2E, Integration, Regression, and User Acceptance Testing (UAT).
• Address NFR and align against standards (e.g. GDPR, HIPAA, HITRUST, etc.)
• AI Validation Logic: Define validation plans for AI components, specifically determining what constitutes "correct" output, setting success thresholds, and establishing evaluation methods (including handling hallucinations and grounding rules).
• Environment & Data
• Create detailed plans for Test Environments (Dev/Test/Prod) and define the Test Data Strategy to ensure sufficient coverage for standard scenarios, edge cases, and ingestion failures.
• Execution & Reporting
• Hands-on Testing: Execute functional, regression, exploratory, performance, and load tests.
• Integration Coordination: Coordinate "Joint End-to-End Validation" efforts, collaborating with the client team to manage testing of Salesforce integration

Languages