Lead AI Red Teaming & QA Engineer

Randstad Technologies Recruitment

City of London, Greater London

We are seeking a Lead AI Red Teaming & QA Engineer to design and execute automated adversarial testing for our enterprise Agentic AI platforms. You will move beyond traditional software QA to build continuous safety pipelines, ensuring our non-deterministic LLM agents, RAG systems, and tool integrations are secure, resilient, and compliant before production release.

Key Responsibilities

Automated Adversarial Testing: Build and integrate automated red teaming suites into CI/CD pipelines using frameworks like Garak, Pyrit, and AgentDojo to enforce strict safety release gates.

AI Evaluation Frameworks: Develop metrics and continuous testing for core AI risks, including hallucinations, memorisation, algorithmic bias, uncertainty, and model drift.

Regulatory Compliance Evidence: Map threat models (OWASP LLM Top 10, Agentic threats) to automated test cases. Produce the technical testing evidence required by EU AI Act Article 15, DORA, and FCA Operational Resilience guidelines.

Centralised AI-BOM Platform: Own the enterprise AI Bill of Materials (AI-BOM), tracking model lineages, dataset versions, and signed artifacts as a centralized evaluation service.

Required Technical Skills

Regulated Finance: Proven experience testing software within FCA, DORA, or EU AI Act frameworks.

AWS Bedrock Ecosystem: Hands-on experience configuring, testing, and bypassing Bedrock Guardrails, Agents, and Knowledge Bases (RAG).

AI Security & Fundamentals: Solid understanding of Foundation Models, tool use (function calling), OWASP LLM Top 10, and NIST AI RMF.

Automation Stack: Strong Python development skills, experience with AI eval tools (Garak, Pyrit, Ragas), and building complex CI/CD test pipelines.

Randstad Technologies is acting as an Employment Business in relation to this vacancy

Posted 2026-05-18

Recommended Jobs

Director, Founder's Office

Zapp

London

Director, Founder's Office Location: Nine Elms, London - Full-time On-Site, Full-Time As a Director, Founder’s Office, you will serve as a strategic partner to the Founder and Executive Lea…

View Details

Posted 2026-04-22

Receptionist - Welcoming Secondary School - Richmond upon...

Marchant Recruitment

Richmond, Greater London

Receptionist – Welcoming Secondary School – Richmond upon Thames Start Date: As soon as possible Contract: Full-time, Permanent Salary: Competitive salary dependent on experience Sch…

View Details

Posted 2026-03-12

Desk Support Engineer - Intune, Microsoft 365, Active Directory

Hays Specialist Recruitment

City of London, Greater London

Desk Support Engineer - Intune, Microsoft 365, Active Directory Market Rate London (on-site)3 months (part time/ 3 days a week) A client of mine is currently looking for an IT Support Eng…

View Details

Posted 2026-05-18

Senior Geotechnical Engineer

Penguin Recruitment

City of London, Greater London

Senior Geotechnical Engineer London £40,000 - £45,000 An expanding and highly respected Ground Investigation Contractor are looking to appoint a Senior Geotechnical Engineer to join their growing Lon…

View Details

Posted 2026-05-18

Logistics Coordinator (12 month fixed term contract)

REISS

London

What’s the role about? We’re looking for a proactive and detail-oriented Logistics Coordinator to join our Logistics team and support the smooth flow of inbound goods into our UK warehouse. This…

View Details

Posted 2026-04-24

Social Media Executive - Brand Hackers

Up Collective

London

At Brand Hackers we help challenger brands fight smarter, think sharper, and win bigger. We’re the secret growth partner trusted by some of the most loved new brands on supermarket shelves and in …

View Details

Posted 2026-04-30

Field Care Supervisor

Radfield Home Care

Croydon, Greater London

Job Title: Field Care Supervisor Location: Croydon and Sutton Contract: Full-Time Pay Rate: £15 per Hour Our mission depends on the giving everyone the right care At Radfi…

View Details

Posted 2026-05-03

Tenancy Relations Officer

Connect2Hackney

Hackney, Greater London

Tenancy Relations Officer Location: Hackney E8 Hybrid - 3 Days in the Office Umbrella Rate: £230.21 to £241.61 a day PAYE Rate: £156.11 to 179.29 a day Full-time (Occasional evening/off-site work …

View Details

Posted 2026-05-18

Programme Manager

London Borough of Haringey

Wood Green, Greater London

Job Category: Interims Location: 48 STATION ROAD, London Borough of Haringey Hours Per Week: 36.00 Start Date: Immediate Start Start Time: 09:00 End Time: 17:30 Salary: £468.49 p…

View Details

Posted 2025-07-30

Executive Assistant (supporting the Executive Team)

Fabric Social

London

The Role This is a shared EA role supporting our Executive Team. We’re looking for someone that keeps four high-output leaders sharp, protected, and a step ahead. You'll manage time, reduce noi…

View Details

Posted 2026-03-25