ApplySarthi

Specialist in machine learning engineering

Jobgether

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

7,593 open engineering roles across 775 companies are on ApplySarthi right now, most of them in Bengaluru (377), Hyderabad (139), Chennai (78).

What engineering roles keep asking for: Python (21%), AWS (20%), Observability (14%), System design (14%), CI/CD (12%) — counted across their open postings here.

AWS jobs · Azure jobs · CI/CD jobs · GCP jobs

Jobgether has 4,683 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for engineering roles keep coming back to Python, AWS, Observability, System design. Practise those questions before you sit with Jobgether.

Questions you are likely to be asked

  1. Why do you want to join Jobgether?
  2. What is your experience with Observability? Tell me one thing you learned the hard way.
  3. What would you check first if a model's accuracy dropped after going live?
  4. When would you not use machine learning for a problem?
  5. Walk me through a model you built, from the data to how it was used.

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Specialist in machine learning engineering at Jobgether interview free →

Accountabilities: You will take ownership of the reliability, performance, and operational excellence of critical AI infrastructure, helping ensure that large-scale machine learning services operate efficiently in production. Your work will combine hands-on engineering, automation, incident management, and cross-functional collaboration. Operate, scale, and optimize multi-tenant LLM inference, model-serving, VectorDB/RAG, and Model Context Protocol (MCP) platforms across global cloud and GPU clusters. Establish and monitor Service Level Objectives (SLOs), Service Level Indicators (SLIs), automated health checks, and observability dashboards using tools such as Prometheus, Grafana, Splunk, and OpenTelemetry. Develop automation for deployment rollouts, autoscaling, canary releases, self-healing systems, and disaster recovery to reduce operational overhead. Optimize GPU utilization and inference performance by improving throughput, latency, model scheduling, batching, caching, and resource allocation using Kubernetes, vLLM, and Ray. Lead complex production incident responses, conduct root-cause investigations using methodologies such as 5 Whys, and implement long-term solutions to prevent recurring issues. Collaborate with AI researchers, product developers, and platform engineering teams to conduct production readiness reviews and ensure reliable service delivery. Participate in a sustainable on-call rotation and continuously improve operational practices, system resilience, and service availability. Requirements : The ideal candidate combines strong software engineering expertise with practical experience operating distributed, cloud-native systems in production environments. You should have a solid understanding of SRE principles, observability, and infrastructure automation, alongside an interest in the challenges of deploying and scaling modern AI workloads. Bachelor's degree in Computer Science, Engineering, or a related field, with at least 5 years of relevant experience, or a Master's degree with at least 3 years of experience. At least 3 years of software development experience using Python, Go, or Java, particularly in building automation tools, infrastructure solutions, or production backend services. Strong experience operating distributed and containerized production systems using Kubernetes, microservices architectures, and CI/CD pipelines. Proven background in Site Reliability Engineering, production operations, distributed systems troubleshooting, and observability. Practical experience with monitoring and observability tools such as Prometheus, Grafana, Splunk, or OpenTelemetry. Working knowledge of at least one major cloud platform: AWS, Microsoft Azure, or Google Cloud Platform (GCP). Hands-on experience with LLM inference and serving frameworks such as vLLM, TensorRT-LLM, Ray Serve, or KServe is highly desirable. Familiarity with GPU orchestration, capacity planning, model parallelism, and performance profiling. Experience managing vector databases, search engines, or distributed caching solutions such as Milvus, Pinecone, or Redis. Understanding of generative AI architectures, including RAG pipelines, model routing, Model Context Protocol (MCP), and agent runtimes. Experience designing highly available multi-region systems, automated remediation solutions, and chaos engineering practices is an advantage. Strong problem-solving, analytical, communication, and collaboration skills, with the ability to work effectively across multidisciplinary engineering teams. Benefits : Fully remote working arrangement. Full-time employment opportunity. Opportunity to work on large-scale AI infrastructure and advanced generative AI technologies. Exposure to distributed systems, GPU computing, and modern machine learning platforms. Collaboration with experienced professionals across AI research, software development, and platform engineering. Opportunities for continuous technical learning, innovation, and professional development. The opportunity to contribute to mission-critical AI services with global reach and impact.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on lever · posted 2026-11-13. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.