Engineering

Senior QA Engineer (Automation Testing)

Lead QA strategy, automate testing, ensure product quality, and validate AI features, APIs, and integrations.

Remote (India) 8+ years in software testing, with at least 4 years in test automation Full-time / Contract

Role summary

We are hiring a senior QA Engineer to own quality across our web products. You will plan testing, build and run automated test suites, and help us release with confidence. You will also test our AI features, including LLM-powered assistance and an MCP server.

Key responsibilities

Test strategy and planning

  • Own the test strategy: what gets tested, how, and when, across unit, API, UI, integration and end-to-end levels.
  • Write test plans and test cases from product requirements, and review requirements early to catch gaps.
  • Decide what to automate and what to keep manual, and track test coverage.

Test automation

  • Design, build and maintain a test automation framework from scratch or improve an existing one.
  • Automate UI tests for the web app, API tests for the REST services, and regression suites that run on every build.
  • Plug automated tests into the CI pipeline so failures block bad releases.
  • Keep tests fast, stable and easy to read; fix flaky tests quickly.

Functional and integration testing

  • Test role-based access, multi-step workflows, dashboards, scoring logic, file uploads and report exports (CSV, PPTX, ZIP).
  • Test single sign-on (OIDC and SAML) and MFA with several identity providers.
  • Check data correctness directly in the databases.
  • Test data migration between product versions.

Release, installation and non-functional testing

  • Test installation, upgrade and uninstall on Windows Server and Linux, including unattended upgrades.
  • Run performance and load tests and report on bottlenecks.
  • Run basic security tests and verify fixes for reported vulnerabilities.
  • Sign off releases and keep clear bug reports and test reports.

Team and process

  • Work closely with developers on testable design and shift-left testing.
  • Mentor junior testers and set QA standards as the team grows.

Required skills and qualifications

Experience

  • 8+ years in software testing, with at least 4 years building and maintaining test automation.
  • Has set up an automation framework and a QA process from the ground up at least once.

Automation tools

  • UI automation: Selenium WebDriver with Java, or Playwright or Cypress for Vue.js front ends.
  • API automation: REST Assured (Java) and Postman/Newman.
  • Test frameworks: JUnit 5 or TestNG; Spock for Groovy code; Cucumber (BDD) is a plus.
  • Performance: Apache JMeter.
  • Security testing: OWASP ZAP, plus working knowledge of the OWASP Top 10.
  • CI and reporting: Jenkins or GitHub Actions, Git, and reports such as Allure.

Product technology (must be able to test against)

  • Java (OpenJDK) and Groovy/Grails backend; Vue.js frontend.
  • MariaDB: write SQL to check data. Neo4j: write Cypher queries to check graph data.
  • Apache Tomcat and TLS configuration.
  • Keycloak; SSO with OIDC and SAML using Okta, Microsoft Entra ID and Auth0; MFA.
  • REST APIs.
  • Windows Server and Linux (Ubuntu) for install and upgrade testing.

Other

  • Strong Java programming skills for writing test code.
  • Clear bug reports and test documentation in written English.
  • Degree in Computer Science or similar, or equivalent hands-on experience.

AI, LLM and MCP testing

Our products include AI features, so the candidate must be able to test software whose output is not always the same.

AreaWhat we expect
LLM output testingBuilding test sets of questions with expected answers; checking accuracy, relevance and made-up facts (hallucination); scoring answers automatically where possible
Regression for AIRe-running AI test sets on every prompt or model change and comparing results to the last release
Prompt injection and safetyTesting whether uploaded files or user input can trick the AI into leaking data or ignoring rules; checking that one customer's data never shows up for another
MCP server testingTesting tools and resources with MCP Inspector and real AI clients; checking that roles and permissions are enforced and every action is logged
API and cost checksVerifying timeouts, retries, error handling, response time and token usage of AI calls

Nice to have

  • ISTQB Advanced or similar testing certification.
  • Experience testing security, compliance or audit-related software.
  • Experience testing on-premises software that customers install themselves.
  • Accessibility testing (WCAG) and cross-browser testing.
  • Experience with AI evaluation tools such as Promptfoo or DeepEval.

What success looks like

  1. First 30 days: Learns the products, writes the test strategy, and gets a smoke test suite running in CI.
  2. By 60 days: Automated regression covers the main user flows and APIs; install and upgrade tests run on Windows and Linux.
  3. By 90 days: Every release goes through automated checks, including AI test sets and MCP server tests, with a clear release sign-off report.

Interview process and how to apply

  1. Intro call (30 min): background, testing experience, availability.
  2. Take-home task (3-4 hours): automate UI and API tests for a small sample web app, run them in a CI pipeline, and write a short bug report on any issues found.
  3. Technical interview (60 min): walk through the task, then design a test strategy for a new feature, including how to test an AI assistant.
  4. Founder chat (30 min): working style, ownership, expectations.

Apply for this role

Send us your details and CV for Senior QA Engineer (Automation Testing). We read every application and will get back to you after reviewing it.

Your details are shared only with our hiring team.