Senior Research Scientist, Agent Evaluation
ServiceNow
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
160 open evaluation roles across 50 companies are on ApplySarthi right now, most of them in Hyderabad (5), Bengaluru (5), Delhi NCR (1).
- AI Voice Evaluation SpecialistJobgether
- Staff Machine Learning Engineer (TLM), Driver Understanding and EvaluationWaymo
- Senior Software Engineer, Autonomy EvaluationGeneralmotors
- Principal AI Engineer - Agentic Systems and Evaluation PlatformAmgen · hyderabad
- Design Evaluation Engineer - Summer 2027Analogdevices
What evaluation roles keep asking for: Python (50%), Machine learning (33%), LLMs (25%), C++ (21%), SQL (18%), PyTorch (17%), Observability (13%), Deep learning (12%) — counted across their open postings here.
Remote Research Scientist jobs · LLMs jobs · Python jobs · ServiceNow jobs
ServiceNow has 810 open roles listed here.
- AI Platform Engineerhyderabad
- Client Director (FSI)
- CRM Account Executive
- CRM Solution Consultant
- CRMソリューションコンサルタント
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for evaluation roles keep coming back to Python, Machine learning, LLMs, C++. Practise those questions before you sit with ServiceNow.
Questions you are likely to be asked
- Why do you want to join ServiceNow?
- What is your experience with ServiceNow? Tell me one thing you learned the hard way.
- Where do you want to be in three years?
- What is a weakness you are working on, and how?
- Tell me about yourself, and why this role is the right next step.
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Senior Research Scientist, Agent Evaluation at ServiceNow interview free →We build the evaluation layer that validates AI agents before they reach customers — an automated system that scores across large volumes of agent traces. You'll own core parts of that platform: the pipeline that runs traces through model-based judges at scale, and the scoring logic that turns raw output into results teams can act on. What you'll do Design evaluation methodologies and benchmarks for agent reasoning, planning, tool use, reliability, and safety — across LLM-as-a-Judge, trajectory-based, and human evaluation Take problems from research question to prototype to shipped feature, owning them end to end Build and harden the pipelines and scoring logic behind customer-facing evaluation Curate synthetic and real-world datasets; measure the evaluator itself for consistency and agreement with human labels What we're looking for 5+ years in ML, applied AI, prompt engineering, agentic AI, including shipping something real to users Strong Python skills Practical depth in agentic AI and context engineering: planning, reasoning, memory, tool use, retrieval, long-context Experience designing evaluation methodologies, not just running evaluations Hands-on production work with LLM APIs — prompt engineering, structured output, cost and latency tradeoffs Clear communication with technical and non-technical audiences Good to have Experience with AI-assisted development tools (Claude code, Windsurf, or similar) Work Personas We approach our distributed world of work with flexibility and trust. Work personas (flexible, remote, or required in office) are categories that are assigned to ServiceNow employees depending on the nature of their work and their assigned work location. Learn more here . To determine eligibility for a work persona, ServiceNow may confirm the distance between your primary residence and the closest ServiceNow office using a third-party service. Equal Opportunity Employer ServiceNow is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, national origin, age, disability, gender identity, veteran status, or any other category protected by law. In addition, all qualified applicants with arrest or conviction records will be considered for employment in accordance with legal requirements. Accommodations We strive to create an accessible and inclusive experience for all candidates. If you require a reasonable accommodation to complete any part of the application process, or are unable to use this online application and need an alternative method to apply, please contact [email protected] for assistance. Export Control Regulations For positions requiring access to controlled technology subject to export control regulations, including the U.S. Export Administration Regulations (EAR), ServiceNow may be required to obtain export control approval from government authorities for certain individuals. All employment is contingent upon ServiceNow obtaining any export license or other approval that may be required by relevant export control authorities. From Fortune. ©2026 Fortune Media IP Limited. All rights reserved. Used under license.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- Manager, Product DesignServiceNow · hyderabad
- Director, UX ResearchServiceNow · hyderabad
- Advisory Solution ConsultantServiceNow · mumbai
- Principal Platform ArchitectServiceNow · mumbai
- Mgr, Software Engrg MgmtServiceNow · bengaluru
- Advisory AI Foundry ArchitectServiceNow · mumbai
- Advisory AI Foundry ArchitectServiceNow · bengaluru
- Principal Platform ArchitectServiceNow · mumbai
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on smartrecruiters · posted 2026-11-16. ApplySarthi collects openings and links to application pages; the role is advertised by ServiceNow, not by us.