ApplySarthi

QA Engineer

Sutherland

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Prep SarthiFree 7-min demoPractise this interview with an AI interviewer, out loud.Unlimited mocks · ₹99/month →Live Sarthi30 min free demoAnswer hints during the real call, hidden from supported screen sharing.Unlimited interviews · ₹99/2 days · Windows →

Skills named in this job

Read from the description itself, not inferred.

This role on the market

481 open QA roles across 133 companies are on ApplySarthi right now, most of them in Bengaluru (47), Hyderabad (17), Pune (9).

What QA roles keep asking for: Agile (26%), CI/CD (25%), Jira (21%), SQL (20%), Test automation (20%), Python (20%), Playwright (19%), Selenium (13%) — counted across their open postings here.

QA Engineer jobs in India · Remote QA Engineer jobs · LLMs jobs

Sutherland has 423 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for QA roles keep coming back to Agile, CI/CD, Jira, SQL. Practise those questions before you sit with Sutherland.

Questions you are likely to be asked

  1. Why do you want to join Sutherland?
  2. What is your experience with LLMs? Tell me one thing you learned the hard way.
  3. What would you automate first, and what would you keep manual?
  4. How do you write a bug report that a developer can act on straight away?
  5. What do you do when a developer says a bug is not a bug?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the QA Engineer at Sutherland interview free →

Role Summary Owns technical testing of agent outputs — accuracy, turnaround-time impact, and regression testing as agents are iterated — feeding the accuracy and completion-time KPIs tracked at the programme level. Key Responsibilities Build test suites validating agent outputs against golden-record datasets across covered processes. Track and report accuracy/turnaround-time metrics to support baselining exercises agreed with the business. Run regression testing whenever agent/prompt configurations change, to prevent silent accuracy drift in regulated processes. Feed findings into the human QA function for final sign-off — this role supports human QA authority on regulated activity with technical evidence, not replaces it. Required Experience 5+ years QA/test engineering experience, ideally including ML/LLM output validation (not just deterministic software testing). Experience defining test datasets and accuracy benchmarks for document/text-processing systems. Domain process familiarity a plus for building realistic test scenarios.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on smartrecruiters · posted 2026-09-29. ApplySarthi collects openings and links to application pages; the role is advertised by Sutherland, not by us.