Java QA Automation Engineer
Qualysoft, Bucharest +1
What you will do
Build API and integration test coverage for Java/Spring routers and database workflows.
- Design and implement Playwright E2E tests for critical user journeys.
- Create stable mocking and fixture strategies (MSW, test fixtures, seeded test data).
- Set up CI quality gates for linting, unit/integration/E2E tests, coverage, and reporting.
- Expand coverage to untested UI and workflow areas and prevent regressions.
- Build an LLM evaluation discipline with golden datasets and measurable quality gates.
- Track model output reliability, detect drift, and gate releases on quality/stability thresholds.
- Improve test maintainability, remove flakiness, and optimize runtime.
- LLM QA Tooling
- Use LangChain4j for JVM-native LLM application support, including agents, RAG, and guardrails.
- Use Langfuse Java SDK and OpenTelemetry for trace capture, prompt/version tracking, and experiment comparison.
- Use the OpenAI Java SDK for structured outputs, function calling, webhook verification, and response validation.