GRADUATE AI TEST AUTOMATION ENGINEER

Job description

Requisition ID 10680 -Posted - Years of Experience (1) - Technology - Where (1) - JobConcept Quality Reply is a QA and software testing company focused on delivering high-quality digital solutions. We providegovernance and production monitoringto ensure ongoing performance and compliance after release. Through advancedtest automationandAI-driven testing strategies, we help organizations accelerate development, reduce risk and ensure reliability across the entire software lifecycle. Our goal is to transform QA into a strategic driver of innovation and efficiency.Role Overview: We are looking for a Graduate AI Test Automation Engineer with expertise in Python and a strong interest in Artificial Intelligence who will support the development of an innovative testing framework for generative AI agents. You will be involved in designing tools for test data generation, automating evaluation processes, and contributing to AI model quality metrics (such as accuracy, bias, consistency and more). This position will allow you to join a cutting-edge project shaping AI testing standards. You'll work with experts in AI, testing, and data governance and will be offered opportunities for quick career progression in a high-impact, AI-driven environment.Responsibilities: As an AI Test Automation Engineer, you will develop and maintain Python-based test automation toolsYou'll collaborate on framework design and third-party tool integrationIn this role, you'll define and implement test strategies for LLM behavior validationSupport continuous testing, benchmarking, and KPI trackingAbout the candidate: You're on track to complete (or have already completed) a Bachelor's or Master's degree in Computer Science, AI, or in a related field (2.1 min grade)Strong interest in AI-driven software testing and developmentYou're proficient in Python and data librariesFamiliarity with LLMs and testing tools (PyTest, Playwright, etc.) would be a major asset for this roleInitial experience with datasets and evaluation metrics (BLEU, ROUGE, etc.) is beneficialYou can demonstrate an analytical mindset and enjoy following a collaborative approach to solving problemsReply is an Equal Opportunities Employer and committed to embracing diversity in the workplace. We provide equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type regardless of age, sexual orientation, gender, identity, pregnancy, religion, nationality, ethnic origin, disability, medical history, skin colour, marital status or parental status or any other characteristic protected by the Law.Reply is committed to making sure that our selection methods are fair to everyone. To help you during the recruitment process, please let us know of any Reasonable Adjustments you may need.

#J-18808-Ljbffr

Extra information

Status

Open

Education Level

Secondary School

Location

London

Type of Contract

Full Time Jobs

Published at

28-03-2026

Full UK/EU driving license preferred

No

Car Preferred

No

Must be eligible to work in the EU

No

Cover Letter Required

No

Languages

English