Senior QA Engineer
Keyloop, UK (Petersfield)
The role
As a Senior QA Engineer, you'll own quality across our product portfolio. You'll define and lead our quality strategy across the full platform, from backend services and agent orchestration through to omnichannel communications.
You'll work closely with engineers and product to build in quality from the start, not just a manual check at the end. You’ll design and execute tests to measure the quality of our AI agents, testing for probabilistic outputs, expected reasoning behaviours, performance and overall security.
What you will do
- Design and own the quality strategy for our AI agent platform, including approaches to testing non-deterministic, LLM-powered systems.
- Build and maintain automated test suites covering unit, integration, API, and end-to-end scenarios across our TypeScript/Node.js/React/Python stack.
- Develop evaluation frameworks for agent behaviour, testing reasoning quality, tool use, memory, and multi-step interaction flows.
- Test and validate our omnichannel communication platform across channels: web, messaging, voice, and beyond.