ApplySarthi

Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project

Jobgether

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

This role on the market

28 open evaluations roles across 12 companies are on ApplySarthi right now, most of them in Bengaluru (3).

What evaluations roles keep asking for: Python (64%), Machine learning (46%), SQL (46%), Accounting (36%), Databricks (36%), Snowflake (36%), scikit-learn (36%), LLMs (29%) — counted across their open postings here.

Jobgether has 4,248 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for evaluations roles keep coming back to Python, Machine learning, SQL, Accounting. Practise those questions before you sit with Jobgether.

Questions you are likely to be asked

  1. Why do you want to join Jobgether?
  2. When would you not use machine learning for a problem?
  3. Walk me through a model you built, from the data to how it was used.
  4. How did you know your model was actually good, and not just good on your test set?
  5. Tell me about a time the data was messy or wrong. What did you do?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Portuguese Audio Evaluations Specialist - Freelance AI Trainer Project at Jobgether interview free →

Accountabilities:: You will independently create evaluation scenarios, assess conversational AI performance, and produce structured data that helps improve the reliability and quality of advanced audio models. Design and conduct realistic role-play scenarios that simulate complex customer support interactions in travel, finance, and technical support. Evaluate AI-generated audio conversations against standardized qualitative and quantitative criteria. Assess task completion accuracy, conversational naturalness, audio comprehension, and the relevance of responses. Review the model's basic programming literacy, including its understanding of JSON structures, functions, methods, and simple logic in customer support contexts. Generate diverse, high-quality audio evaluation datasets that reflect real-world expectations for clarity, efficiency, and natural conversation. Follow detailed prompts, evaluation rubrics, and technical guidelines to ensure consistent and reliable results. Identify weaknesses in model performance and provide structured evaluation outputs to support improvements in conversational AI. Requirements: The ideal candidate has strong Portuguese language skills, professional experience in customer-facing or technical support environments, and the ability to evaluate complex conversations systematically. You should be comfortable working independently and following precise technical instructions. Native or bilingual proficiency in Portuguese, with strong reading, listening, writing, and speaking skills. Professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation. Strong analytical abilities and verbal communication skills, including the ability to perform realistic customer support role-plays. Basic programming literacy, including familiarity with JSON structures, functions, methods, and simple logic. Excellent attention to detail when working with structured prompts, evaluation frameworks, and technical requirements. Access to a high-quality microphone to ensure clear and reliable audio input during evaluations. A secure computer and high-speed internet connection suitable for remote work. Ability to work autonomously as a freelance or independent contractor. Benefits: Compensation ranging from USD 6 to USD 65 per hour, depending on experience, expertise, and geographic location. The final rate may vary from the advertised range. Fully remote work arrangement. Freelance/independent contractor engagement. Opportunity to contribute to the evaluation and improvement of advanced conversational AI models. Flexible project-based work environment, subject to project requirements. Contractors must provide their own computer and high-speed internet. Health insurance and paid time off are not included in this independent contractor engagement.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on lever · posted 2026-10-12. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.