ApplySarthi

Data Analyst (AI Evaluation)

Jobgether

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

94 open evaluation roles across 31 companies are on ApplySarthi right now, most of them in Hyderabad (10), Bengaluru (3), Delhi NCR (1).

What evaluation roles keep asking for: Python (26%) — counted across their open postings here.

Data Analyst jobs in the United States · Remote Data Analyst jobs · Machine learning jobs · SQL jobs

Jobgether has 4,574 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for evaluation roles keep coming back to Python. Practise those questions before you sit with Jobgether.

Questions you are likely to be asked

  1. Why do you want to join Jobgether?
  2. What is your experience with Machine learning? Tell me one thing you learned the hard way.
  3. When would you not use machine learning for a problem?
  4. Walk me through a model you built, from the data to how it was used.
  5. How did you know your model was actually good, and not just good on your test set?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Data Analyst (AI Evaluation) at Jobgether interview free →

Accountabilities:: Review datasets and detailed task outputs systematically to assess accuracy, completeness, consistency, and compliance with established guidelines. Identify, document, and flag errors, inconsistencies, omissions, and outputs that do not meet specified requirements. Apply structured evaluation rubrics and quality criteria consistently across large volumes of data and review assignments. Use sound analytical judgment to evaluate ambiguous cases, interpret available guidance, and make defensible decisions when instructions are incomplete. Provide clear written and verbal feedback that precisely identifies issues, explains their impact, and recommends appropriate resolution paths. Identify recurring patterns, systemic data-quality issues, and trends that require escalation or further investigation rather than isolated correction. Maintain a high level of accuracy and consistency while completing repetitive, high-volume data review tasks. Follow detailed procedures and quality standards carefully while adapting to evolving project requirements and evaluation guidelines. Requirements: Bring 3–5+ years of experience in data analysis, data review, data quality, quality assurance, or another analytical discipline. Demonstrate proven experience reviewing, validating, auditing, or critiquing data, deliverables, or other structured outputs against defined criteria. Possess an exceptional ability to follow detailed written instructions and apply complex evaluation rubrics accurately and consistently. Demonstrate strong analytical reasoning and the ability to make well-supported decisions in situations where guidelines may be incomplete or ambiguous. Have excellent attention to detail and a proven ability to identify subtle errors, inconsistencies, and quality issues across high-volume work. Possess strong written and verbal communication skills, particularly for documenting findings, explaining rationale, and providing actionable feedback. Be highly organized and capable of maintaining consistent quality and productivity across repetitive assignments. Demonstrate strong independent judgment, reliability, and the ability to work effectively in a remote environment. Have baseline proficiency with spreadsheets, including sorting, filtering, and simple formulas. Experience with SQL, data querying, or other analytical tools is a plus. Prior experience working with artificial intelligence or machine learning is not required; strong domain expertise and analytical judgment are the primary focus. Benefits: Remote contractor opportunity with flexible participation in AI-focused data quality projects. Opportunity to apply existing data and analytical expertise to the development and evaluation of next-generation AI systems. Direct contribution to improving how AI models learn, reason, and perform through high-quality real-world data and evaluation. No prior artificial intelligence experience required. Opportunity to work on emerging AI initiatives while leveraging established professional expertise. Competitive and attractive compensation package. The contractor nature of the role provides an opportunity to contribute to project-based work remotely.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on lever · posted 2026-09-30. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.