AI Test Engineer

Job description

Company Description

At CluePoints, we’re redefining how clinical trials are run. As the premier provider of Risk-Based Quality Management (RBQM) and Data Quality Oversight software, we harness advanced statistics, artificial intelligence, and machine learning to ensure the quality, accuracy, and integrity of clinical trial data, helping life sciences organizations bring safer, more effective treatments to patients faster.

We’re proud to be an ambitious, fast-growing technology scale-up with a dynamic and diverse international team representing more than 20 nationalities. Collaboration, flexibility, and continuous learning are part of our DNA.

At CluePoints, you’ll find a culture where you can grow, make an impact, and have fun along the way. Guided by our values of Care, Passion, and Smart Disruption, we’re united by a shared mission: to create smarter ways to run efficient clinical trials and deliver AI-powered insights that improve human outcomes worldwide.

We are looking for a highly skilled AI Tester with strong Playwright expertise who embraces an AI-First approach to quality engineering.

In this role, your primary focus will be testing AI-powered features implemented within the application; ensuring their reliability, accuracy, robustness, explainability, and compliance with product expectations.

While automation remains a critical capability, this role requires a strong understanding of how AI-driven functionality behaves in real-world scenarios, including edge cases, model variability, and prompt-driven outputs.

You will play a key role in validating AI features end-to-end — from requirement analysis and test design to automated validation, exploratory testing, and model behavior analysis, while continuing to leverage AI tools like GitHub Copilot/Codex to accelerate test development.

Job requirements

What You’ll Bring

• Experience testing AI-driven or data-driven systems (LLMs, ML models, rule engines, recommendation systems, NLP-based features, etc.).
• Understanding of AI/MLbehaviorconcepts such as prompt variability, non-deterministic outputs, confidence thresholds, bias, hallucinations, and edge-case handling.
• Ability to design validation strategies for probabilistic systems where results may not always be binary (pass/fail).
• Strong hands-on experience withPlaywright automation framework.
• ProficiencyinJavaScript or TypeScript.
• DemonstratedexpertiseusingGitHub Copilot, Codex, or AI coding assistantsas part of daily development workflow.
• Solid understanding ofautomation framework architecture and design patterns.

• Regulatory experience in the pharmaceuticals (clinical trials), Insurance / Banking / Fintech (advantageous)

Job responsibilities

• Designing and executing comprehensive test strategies specifically forAI-powered features within the application.
• Validating AI outputs for accuracy, consistency, edge-case handling, and alignment with business requirements.
• Designing prompt-based and scenario-driven tests to evaluate model behavior, under varied inputs.
• Defining measurable validation criteria for non-deterministic systems (confidence ranges, tolerance thresholds, expected behavior patterns).
• Collaborating with engineering and product teams to improve explainability, observability, and traceability of AI decisions.
• EnsuringAI features meet quality, compliance, and audit requirements where applicable.
• Leveraging AI coding assistants (e.g., GitHub Copilot, Codex, or similar tools) to accelerate test development and framework enhancement.
• Using AI tools to generate high-quality test scenarios from requirements and user stories.
• Reviewing, validating, and refining AI-generated test code to ensure accuracy, scalability, and maintainability.
• Contributing to AI-driven test design patterns and reusable automation strategies.
• Promoting AI-augmented productivity practices within the QA team.

• Designing, developing, and maintaining scalable Playwright-based automation frameworks for UI, API, and end-to-end testing.
• Integrating automated test suites into CI/CD pipelines (GitHub Actions, Azure DevOps, Jenkins, etc.).
• Performing exploratory testing to uncover edge cases, usability gaps, and unexpected system behavior.

Job benefits

• Private Medical Insurance through Vitality Health (full hospital cover, 24/7 GP, and therapy sessions)
• Group Critical Illness Cover with Aviva
• Life Insurance (death-in-service lump sum)
• Pension Scheme with 9% employer contribution via Scottish Widows
• Opportunities for professional development and sponsored certifications
• A hub-based hybrid model that blends flexibility with purpose — connecting teams through collaboration, learning, and a vibrant social culture.