ApplySarthi

Software Engineer, AI Infrastructure

Nvidia

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

2,345 open infrastructure roles across 336 companies are on ApplySarthi right now, most of them in Bengaluru (125), Hyderabad (26), Delhi NCR (12).

What infrastructure roles keep asking for: AWS (31%), Python (29%), Observability (27%), System design (26%), Kubernetes (25%), CI/CD (19%), Linux (18%), Terraform (18%) — counted across their open postings here.

Software Engineer jobs in Israel · Software Engineer jobs in Tel Aviv · Remote Software Engineer jobs · Kubernetes jobs · Linux jobs · Observability jobs

Nvidia has 3,642 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for infrastructure roles keep coming back to AWS, Python, Observability, System design. Practise those questions before you sit with Nvidia.

Questions you are likely to be asked

  1. Why do you want to join Nvidia?
  2. What is your experience with Kubernetes? Tell me one thing you learned the hard way.
  3. What would you check first if a model's accuracy dropped after going live?
  4. When would you not use machine learning for a problem?
  5. Walk me through a model you built, from the data to how it was used.

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Software Engineer, AI Infrastructure at Nvidia interview free →

AI factories are only as good as the software that runs them. NVIDIA’s DSX OS turns GPU infrastructure into a shared, multi-tenant platform for AI teams, providing scheduling, orchestration, serving, and observability for AI workloads at data-center scale—from training and inference to reinforcement learning and agentic AI.The DSX OS Platform Software group builds that layer through projects such as KAI-Scheduler, Snapshot, Grove, and Run:ai. Our work ships as open source and upstream contributions across the cloud-native and AI serving ecosystems. We focus on performance, reliability at scale, and giving users the insight they need to understand and improve how their workloads run. We are looking for highly skilled software engineers to help shape the future of AI infrastructure. As a Software Engineer in the team, you will design and build scalable, high-performance systems, tackle complex distributed-systems problems, and collaborate with experts across NVIDIA and the broader community to support the next generation of AI workloads. What you’ll be doing: Designing and developing open source platform components with a strong focus on performance, reliability, and scalability. Building and optimizing Kubernetes-native systems: controllers, operators, schedulers, and APIs that orchestrate GPU workloads at scale. Contributing upstream — designing in public, writing proposals, reviewing community code, and engaging with users and maintainers of the projects we work on. Collaborating closely with architects, product managers, and partner teams across NVIDIA to deliver impactful solutions. Writing clean, maintainable, and testable code in Go. Conducting code and design reviews to uphold high-quality standards. What we need to see: B.Sc. in Computer Science or a related field or equivalent experience. 2+ years of experience in backend software development, including system design and architecture. Proficiency in at least one backend programming language. Deep familiarity with Kubernetes and the cloud-native ecosystem. Demonstrated ability to solve complex technical challenges and deliver high-quality solutions. Ways to stand out from the crowd: Expertise in Kubernetes internals and advanced cloud-native technologies. Maintain or contribute to OSS projects, and experience working in a public development process. Familiarity with AI inference workloads, serving frameworks, and performance optimization. Proficiency in Linux, with knowledge in networking, security, storage, and virtualization.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on workday · posted 2026-11-03. ApplySarthi collects openings and links to application pages; the role is advertised by Nvidia, not by us.