ApplySarthi

Principal DevOps Engineer (AI/ML Infrastructure)

Jobgether

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

2,701 open infrastructure roles across 369 companies are on ApplySarthi right now, most of them in Bengaluru (143), Hyderabad (25), Delhi NCR (12).

What infrastructure roles keep asking for: Python (32%), AWS (30%), Observability (26%), Kubernetes (25%), System design (25%), Linux (19%), Terraform (19%), CI/CD (17%) — counted across their open postings here.

Remote DevOps Engineer jobs · AWS jobs · Ansible jobs · Azure jobs · CI/CD jobs

Jobgether has 4,683 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for infrastructure roles keep coming back to Python, AWS, Observability, Kubernetes. Practise those questions before you sit with Jobgether.

Questions you are likely to be asked

  1. Why do you want to join Jobgether?
  2. What is your experience with Machine learning? Tell me one thing you learned the hard way.
  3. How did you know your model was actually good, and not just good on your test set?
  4. Tell me about a time the data was messy or wrong. What did you do?
  5. How would you explain your model's result to someone who is not technical?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Principal DevOps Engineer (AI/ML Infrastructure) at Jobgether interview free →

Accountabilities: Architect, design, and lead the implementation of scalable, secure, resilient, and high-performance infrastructure to support demanding AI and machine learning workloads. Build, maintain, and optimize specialized CI/CD pipelines for AI/ML applications, covering the complete lifecycle from data ingestion and model development to deployment, serving, and monitoring. Design and manage cloud-based AI/ML infrastructure, leveraging containerization, orchestration, and platform engineering technologies to ensure scalability and operational efficiency. Drive automation across infrastructure provisioning, model deployment, testing, and operational workflows to improve reliability, consistency, and development speed. Collaborate closely with AI researchers, data scientists, and software engineers to streamline experimentation processes and translate machine learning models into reliable production applications. Ensure the security, availability, reliability, and performance of AI/ML systems through effective infrastructure management, monitoring, and continuous optimization. Act as a technical subject matter expert, mentoring junior engineers and promoting best practices in AI/ML platform development, source control, automation, and deployment. Identify emerging technologies, tools, and industry trends, evaluating innovative solutions that can strengthen infrastructure capabilities and accelerate AI/ML development. Requirements: At least 5 years of professional experience in DevOps, machine learning infrastructure, or platform engineering, including several years in a senior technical or leadership capacity. At least 5 years of advanced experience with one or more major cloud platforms, such as AWS, Microsoft Azure, or Google Cloud Platform (GCP), including their AI/ML and containerization services. Minimum 5 years of hands-on experience with machine learning orchestration and platform technologies such as Kubeflow, MLflow, or Amazon SageMaker. Approximately 5–8+ years of strong expertise in Docker and Kubernetes, particularly for deploying, managing, and scaling AI/ML workloads. Approximately 5–8+ years of programming experience with languages such as Python, Go, or Bash, with a strong focus on scripting and infrastructure automation. Experience with infrastructure-as-code and configuration management tools such as Terraform or Ansible. Demonstrated ability to design and implement reliable automated CI/CD pipelines using tools such as GitHub Actions, GitLab CI/CD, or Jenkins. Strong understanding of DevOps principles, cloud infrastructure, container orchestration, automation, scalability, and security best practices. Excellent communication and collaboration skills, with the ability to work effectively alongside AI researchers, software developers, infrastructure specialists, and business stakeholders. Strong technical problem-solving skills, initiative, and the ability to drive complex infrastructure projects independently. A valid LinkedIn profile and relevant professional work links must be included with your application. Must be based in Canada and available to work Eastern Standard Time (EST) business hours. Benefits: Competitive annual base salary: CAD $130,000–$165,000, depending on experience, qualifications, work location, and internal compensation considerations. Fully remote opportunity: Work remotely from anywhere within Canada. Full-time position: Long-term opportunity in a newly created role. Technical leadership: Take ownership of strategic AI/ML infrastructure initiatives and influence platform engineering practices. Professional development: Work with modern cloud technologies, machine learning platforms, container orchestration, and advanced automation tools. Collaborative environment: Partner with experienced AI researchers, software engineers, and R&D professionals. Innovation and impact: Contribute to the development of AI-powered scientific software solutions supporting research, discovery, and innovation. Additional employee benefits may be available depending on the position and employment package offered.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on lever · posted 2026-11-13. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.