Senior Software Development Test Engineer (SDET), AI & Automation

Responsibilities

• Partner directly with AI engineers, Software Engineers and Product Managers during design and development to define test strategy, acceptance criteria and automation requirements
• Design and maintain automated testing frameworks for AI-powered applications, backend services, APIs and supporting software systems
• Develop testing strategies for both deterministic software behavior and non-deterministic AI/ML outputs
• Define measurable evaluation criteria, tolerances and quality thresholds for AI model and LLM-driven functionality
• Build automated regression, integration, API and end-to-end coverage alongside feature development
• Develop test harnesses and evaluation workflows for prompts, models, agents, tool-calling workflows and AI-integrated applications
• Validate AI behavior across different models, prompts, inputs and system configurations
• Develop automated test utilities using languages such as Python, Java, JavaScript/TypeScript, Rust or similar technologies
• Integrate automated validation and quality gates into CI/CD pipelines using GitHub Actions, Jenkins, GitLab CI or similar platforms
• Build and maintain test datasets, mocks, fixtures and synthetic data required for repeatable AI and software validation

Languages