3006 IT & Software Developer jobs in the UK

MarkIT Placements jobs

Test & AI Evaluation Lead

£39,000 - 79,000
MarkIT Placements
Orchard-Leigh, Chilton
£39,000 - 79,000
Company Size icon
Company Size
<50
Company Type icon
Company Type
Services
Exp Level icon
Exp Level
Lead
Job Type icon
Job Type
Full-Time
Language icon
Language
English
Visa sponsorship icon
Visa sponsorship
No

Requirements

Must:
- Proven experience as a Test Manager, Senior Test Lead, or equivalent on complex software systems. - Strong track record of taking applications into production in regulated environments. - Strong background in automated testing across APIs, services, and UIs, integrated into CI/CD pipelines. - Experience testing distributed, cloud-native systems (AWS, GCP, or Kubernetes), including performance, reliability, and resilience. - Awareness of compliance frameworks (e.g. ISO 27001, NIST, OWASP). - ISTQB Advanced / Test Manager certification or equivalent practical experience. - SC Clearance or eligibility to obtain UK SC Clearance. - Experience in UK defence, public sector, or security environments (preferred). - Experience testing AI/ML/LLM-based systems, including non-deterministic outputs (preferred). - Exposure to agent-based or workflow-driven architectures (preferred). - A pragmatic, delivery-focused mindset - able to balance speed with rigour. - Strong written and verbal communication, especially around complex technical risk.

Responsibilities

- Define and own the end-to-end test strategy across AI, backend, frontend, and infrastructure layers. - Establish testing standards appropriate for agentic AI systems, including non-deterministic behaviour and probabilistic outputs. - Ensure testing aligns with mission-critical, safety-conscious, and security-first delivery expectations. - Act as the primary quality authority across projects, advising engineering and product leadership on risk and readiness. - Design approaches for testing multi-agent workflows, including orchestration logic, memory/state handling, and tool integrations. - Define validation strategies for LLM outputs, including groundedness, hallucination detection, task success rates, and regression testing. - Work with AI Engineers to embed evaluation metrics and pass/fail thresholds into pipelines. - Validate data ingestion, transformation, and inference pipelines across structured and unstructured data sources. - Drive a test-automation-first mindset, integrating tests into CI/CD pipelines (GitHub Actions, Argo CD). - Oversee automated testing across API and service layers, UI (E2E and accessibility), and infrastructure and deployment workflows. - Select, implement, and evolve testing tools and frameworks appropriate to modern cloud-native and AI systems. - Own performance, scalability, reliability, and resilience testing for distributed systems. - Coordinate security testing activities in line with secure-by-design principles. - Validate backup, disaster recovery, and failover scenarios alongside DevOps and Backend teams. - Embed with delivery teams to ensure testing is planned early and executed continuously. - Work closely with Product and Engineering to define clear acceptance criteria and definition of done. - Provide clear, decision-ready quality reporting to technical and non-technical stakeholders. - Support customer-facing demonstrations, trials, and operational readiness assessments.

Description


We are hiring a Test & AI Evaluation Lead who will own the validation processes for our AI-driven, mission-critical systems, including multi-agent orchestration and LLM outputs. This role is ideal for those who enjoy close engagement with technology and have a genuine passion for influencing system development while ensuring the highest quality. As part of our collaborative team, you will work alongside AI, Backend, Frontend, and DevOps engineers, emphasizing quality from the outset. We offer a flexible working environment, the opportunity for rapid career progression, and the chance to shape the direction of our innovative, early-stage company.
Something wrong or incorrect with this job? Tell us in the chat 💬 on the right ➡️
You can find QA, Test Engineer salaries in the UK here.

How many QA, Test Engineer jobs are in the UK?

Currently, there are 3006 QA, Test openings. Check also: Selenium jobs, Cypress jobs, Cucumber jobs - all with salary brackets.

Is the UK a good place for QA, Test Engineers?

The UK is one of the best countries to work as a QA, Test Engineer. It has a vibrant startup community, growing tech hubs and, most important: lots of interesting jobs for people who work in tech.

Which companies are hiring for QA, Test Engineer jobs in the UK?

Bluefruit Software Limited, Unum Group, EG Group, RevOps Automated, eonnext, Roots Plants, Leger Shearings Group among others, are currently hiring for QA, Test roles in the UK.

The company with most openings is Experis as they are hiring for 93 different QA, Test Engineer jobs in the UK. They are probably quite committed to find good QA, Test Engineers.