Job Description
Position
Senior AI Test Automation Engineer – Hybrid, Madrid
Responsibilities
- Own the design, architecture, and evolution of the test automation framework for the AI & MLOps platform
- Define and implement scalable, reusable automation patterns (UI, API, data, BDD)
- Automate test cases using Python stack (Playwright, pytest, requests, pytest-bdd/Behave) applying clean code practices
- Design and execute AI/ML‑specific tests (e.g., LLM evaluation, RAG validation, non‑deterministic outputs)
- Integrate and orchestrate automated tests within CI/CD pipelines (GitLab), ensuring reliable execution across environments
- Provision and manage test environments using Docker and Kubernetes
- Plan and execute regression, smoke, and release test suites across DEV, INT, UAT, and pre‑PROD
- Monitor execution quality, manage flaky tests, and ensure trustworthy test results
- Analyze defects, perform root cause...