Senior Automation Tester in Python (for Gen AI powered applications)

EPAM Systems

Remote · PolandSalary not disclosedfull-timeEPAM Systems Careers (remote abroad)

We are looking for a Senior Automation Tester in Python to join Production Pods within the program. This is not a manual/functional QA role.

Responsibilities

Build automated test frameworks from scratch for AI-powered clinical applications using Playwright, Selenium, and pytest
Design and execute test strategies for non-deterministic AI/GenAI outputs, including accuracy, RAG relevance, hallucination checks, and prompt regression
Integrate automated tests into CI/CD pipelines with quality gates such as block-on-failure and coverage thresholds
Execute GxP-compliant IQ/OQ/PQ scripts and generate qualification evidence packages
Manage AI-specific test data, including edge cases, adversarial inputs, and golden datasets
Monitor model drift, regression, and performance degradation over time
Produce test strategy documents, test plans, and compliance-ready test evidence
Collaborate with Data Scientists and Backend Developers to define testable acceptance criteria for AI features