Principal Software Engineer, Cloud Infrastructure
Nvidia
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
2,511 open infrastructure roles across 346 companies are on ApplySarthi right now, most of them in Bengaluru (140), Hyderabad (26), Delhi NCR (13).
- Monitoring-Operations Support-Infrastructure MonitoringZensar
- Infrastructure Lead – Cloud Native ArchitectureOracle
- Infrastructure Tooling & Observability Engineer (UK)Radiant
- Senior AI Research Engineer - LLM Training & Inference InfrastructureDatadog
- Senior Software Engineer, Infrastructure and EfficiencyRoku
What infrastructure roles keep asking for: AWS (30%), Python (30%), Observability (25%), System design (25%), Kubernetes (24%), Linux (20%), Terraform (18%), CI/CD (17%) — counted across their open postings here.
Software Engineer jobs in the United States · Remote Software Engineer jobs · Linux jobs · MySQL jobs · Python jobs
Nvidia has 3,820 open roles listed here.
- Software Developer - Networking
- Manager, Silicon Circuit and Power Integrity - Silicon Co-Design Group
- Senior Physical Design Methodology Engineerbengaluru
- Electro Optics Student
- Manager, Software Verification
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for infrastructure roles keep coming back to AWS, Python, Observability, System design. Practise those questions before you sit with Nvidia.
Questions you are likely to be asked
- Why do you want to join Nvidia?
- What is your experience with System design? Tell me one thing you learned the hard way.
- Tell me about an outage you handled. What did you learn from it?
- How do you decide what to monitor, and what should wake someone up at night?
- How would you cut the cloud bill of a system without hurting it?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Principal Software Engineer, Cloud Infrastructure at Nvidia interview free →We are seeking a Principal Software Engineer to drive the architecture and development of our bare-metal and cloud compute infrastructure. Our organization supports hundreds of megawatts of datacenter capacity, making a growing physical fleet available as reliable, secure, and efficient compute services for NVIDIA engineering. We operate an NVIDIA GPU Private cloud that provides infrastructure for continuous integration and validation. Hardware, firmware, drivers, networking, and system software are coordinated and tested on their path to production. The fleet includes x86 and Arm servers, GPUs, DPUs, high-speed networking, storage, and rack-scale systems. Platforms include Grace Blackwell and Vera Rubin. In this senior individual contributor role, you will combine hands-on software engineering with architectural leadership. You will evolve our OpenStack platform, automate infrastructure operations, and address complex systems challenges across multiple datacenters. What you'll be doing: Own architecture and lead implementation of large-scale OpenStack infrastructure supporting bare-metal provisioning, virtual machines, and engineering workloads spanning several datacenters around the globe. Architect and implement Infrastructure as Code frameworks to automate provisioning, configuration, and lifecycle management across OpenStack and bare-metal environments, using version-controlled definitions, automated validation, drift detection, and safe rollback. Build and improve compute control planes, resource scheduling, topology-aware placement, reservations, and capacity management for heterogeneous hardware. Develop and extend OpenStack services and integrations, including Nova, Neutron, Ironic, Cinder, Keystone, and Placement, based on platform requirements. Improve platform scalability, availability, and performance through architectural changes, profiling, failure analysis, and detailed elimination of operational bottlenecks. Build safe deployment, upgrade, migration, and rollback mechanisms that minimize disruption to engineering workloads. Partner with SRE, datacenter operations, security, product engineering teams to onboard new platforms and resolve failures across system boundaries. What we need to see: 15+ years of proven experience in software engineering, distributed systems, or cloud infrastructure, demonstrating leadership in diverse technical initiatives across teams. BS or MS in Computer Science, Computer Engineering, or a related field, or equivalent experience. Deep experience crafting, developing, deploying, and fixing production OpenStack environments, particularly Nova, Neutron, and Ironic. Strong software development skills in Python and experience building maintainable services, APIs, and infrastructure automation. Strong understanding of distributed systems, including concurrency, state management, asynchronous workflows, failure handling, and recovery. Deep Linux systems knowledge and experience with virtualization, KVM/QEMU, containers, and guest operating-system provisioning. Proven understanding of cloud networking, including L2/L3 networking, VLANs, overlays, DHCP, PXE boot, routing, and tenant isolation. Experience with databases and messaging infrastructure supporting cloud control planes, such as MySQL/MariaDB and RabbitMQ. Experience operating infrastructure with demanding reliability requirements, including monitoring, incident response, system resources, and production upgrades. Excellent debugging skills across hardware, firmware, operating systems, communication systems, data storage, and distributed services. Ability to translate ambiguous requirements into technical direction and influence engineering teams across organizational boundaries and time zones. Ways to stand out from the crowd: Contributions to OpenStack or related open-source projects, including upstream features, bug fixes, performance improvements, or architectural proposals. Experience scaling OpenStack across multiple regions or datacenters, including control-plane resilience, fleet upgrades, and workload migration. Expertise in Ironic, Redfish, BMC integration, and provisioning or recovering large bare-metal fleets. Experience with Ceph, distributed storage, and storage integration with OpenStack. Experience with GPU and Arm platforms, PCIe pass-through, SR-IOV, NVLink, InfiniBand, or high-speed Ethernet. A record of delivering architectural improvements that measurably increase reliability, scalability, utilization, or developer efficiency. NVIDIA brings together engineers working on some of the most ambitious problems in computing. Join us to build the infrastructure that enables the next generation of NVIDIA hardware and software. Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer to you and your family www.nvidiabenefits.com/ Your base salary will be determined based on your location, experience, and other objective job-related factors. The expected base salary range for this position is 272,000 USD – 431,250 USD. You will also be eligible for equity and benefits . Applications for this job will be accepted at least until November 13, 2026. This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- Head of Startups - India and South AsiaNvidia · bengaluru
- Manager, AI/HPC Infrastructure Technical Delivery — IndiaNvidia · pune
- Architect – AI-Powered Performance Verification AutomationNvidia · bengaluru
- Data Center Infrastructure SpecialistNvidia · bengaluru
- Senior Developer Relations ManagerNvidia · bengaluru
- Server Performance Architect - HardwareNvidia · bengaluru
- Senior Solutions Architect, Infiniband and Networking Ethernet - NVISNvidia · bengaluru
- Senior Software Engineer, Fabric Networking - GPUNvidia · bengaluru
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on workday · posted 2026-11-09. ApplySarthi collects openings and links to application pages; the role is advertised by Nvidia, not by us.