Senior QA Engineer (Automation Testing)
Lead QA strategy, automate testing, ensure product quality, and validate AI features, APIs, and integrations.
Role summary
We are hiring a senior QA Engineer to own quality across our web products. You will plan testing, build and run automated test suites, and help us release with confidence. You will also test our AI features, including LLM-powered assistance and an MCP server.
Key responsibilities
Test strategy and planning
- Own the test strategy: what gets tested, how, and when, across unit, API, UI, integration and end-to-end levels.
- Write test plans and test cases from product requirements, and review requirements early to catch gaps.
- Decide what to automate and what to keep manual, and track test coverage.
Test automation
- Design, build and maintain a test automation framework from scratch or improve an existing one.
- Automate UI tests for the web app, API tests for the REST services, and regression suites that run on every build.
- Plug automated tests into the CI pipeline so failures block bad releases.
- Keep tests fast, stable and easy to read; fix flaky tests quickly.
Functional and integration testing
- Test role-based access, multi-step workflows, dashboards, scoring logic, file uploads and report exports (CSV, PPTX, ZIP).
- Test single sign-on (OIDC and SAML) and MFA with several identity providers.
- Check data correctness directly in the databases.
- Test data migration between product versions.
Release, installation and non-functional testing
- Test installation, upgrade and uninstall on Windows Server and Linux, including unattended upgrades.
- Run performance and load tests and report on bottlenecks.
- Run basic security tests and verify fixes for reported vulnerabilities.
- Sign off releases and keep clear bug reports and test reports.
Team and process
- Work closely with developers on testable design and shift-left testing.
- Mentor junior testers and set QA standards as the team grows.
Required skills and qualifications
Experience
- 8+ years in software testing, with at least 4 years building and maintaining test automation.
- Has set up an automation framework and a QA process from the ground up at least once.
Automation tools
- UI automation: Selenium WebDriver with Java, or Playwright or Cypress for Vue.js front ends.
- API automation: REST Assured (Java) and Postman/Newman.
- Test frameworks: JUnit 5 or TestNG; Spock for Groovy code; Cucumber (BDD) is a plus.
- Performance: Apache JMeter.
- Security testing: OWASP ZAP, plus working knowledge of the OWASP Top 10.
- CI and reporting: Jenkins or GitHub Actions, Git, and reports such as Allure.
Product technology (must be able to test against)
- Java (OpenJDK) and Groovy/Grails backend; Vue.js frontend.
- MariaDB: write SQL to check data. Neo4j: write Cypher queries to check graph data.
- Apache Tomcat and TLS configuration.
- Keycloak; SSO with OIDC and SAML using Okta, Microsoft Entra ID and Auth0; MFA.
- REST APIs.
- Windows Server and Linux (Ubuntu) for install and upgrade testing.
Other
- Strong Java programming skills for writing test code.
- Clear bug reports and test documentation in written English.
- Degree in Computer Science or similar, or equivalent hands-on experience.
AI, LLM and MCP testing
Our products include AI features, so the candidate must be able to test software whose output is not always the same.
| Area | What we expect |
|---|---|
| LLM output testing | Building test sets of questions with expected answers; checking accuracy, relevance and made-up facts (hallucination); scoring answers automatically where possible |
| Regression for AI | Re-running AI test sets on every prompt or model change and comparing results to the last release |
| Prompt injection and safety | Testing whether uploaded files or user input can trick the AI into leaking data or ignoring rules; checking that one customer's data never shows up for another |
| MCP server testing | Testing tools and resources with MCP Inspector and real AI clients; checking that roles and permissions are enforced and every action is logged |
| API and cost checks | Verifying timeouts, retries, error handling, response time and token usage of AI calls |
Nice to have
- ISTQB Advanced or similar testing certification.
- Experience testing security, compliance or audit-related software.
- Experience testing on-premises software that customers install themselves.
- Accessibility testing (WCAG) and cross-browser testing.
- Experience with AI evaluation tools such as Promptfoo or DeepEval.
What success looks like
- First 30 days: Learns the products, writes the test strategy, and gets a smoke test suite running in CI.
- By 60 days: Automated regression covers the main user flows and APIs; install and upgrade tests run on Windows and Linux.
- By 90 days: Every release goes through automated checks, including AI test sets and MCP server tests, with a clear release sign-off report.
Interview process and how to apply
- Intro call (30 min): background, testing experience, availability.
- Take-home task (3-4 hours): automate UI and API tests for a small sample web app, run them in a CI pipeline, and write a short bug report on any issues found.
- Technical interview (60 min): walk through the task, then design a test strategy for a new feature, including how to test an AI assistant.
- Founder chat (30 min): working style, ownership, expectations.
Apply for this role
Send us your details and CV for Senior QA Engineer (Automation Testing). We read every application and will get back to you after reviewing it.
Other open roles.
Software Engineer (Full-Stack, AI & LLM Integration)
Build scalable web applications, secure APIs, and AI-powered features with LLM and MCP integrations.
View roleEngineering · 3–5 yearsFull Stack Developer
Build secure web applications, APIs and AI-powered features for clients and for our own security platforms, with a modern TypeScript and Python stack.
View role