ApplySarthi

Senior Solutions Architect – Large Scale AI Training

Nvidia

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

3,482 open solutions roles across 496 companies are on ApplySarthi right now, most of them in Bengaluru (125), Hyderabad (33), Delhi NCR (30).

What solutions roles keep asking for: AWS (30%), Python (22%), Stakeholder management (16%), Azure (16%), Customer success (16%), SaaS (14%), GCP (14%), Product management (14%) — counted across their open postings here.

Solutions Architect jobs in Switzerland · Solutions Architect jobs in Spain · Solutions Architect jobs in France · Solutions Architect jobs in the United Kingdom · Solutions Architect jobs in Poland · Remote Solutions Architect jobs

Nvidia has 3,820 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for solutions roles keep coming back to AWS, Python, Stakeholder management, Azure. Practise those questions before you sit with Nvidia.

Questions you are likely to be asked

  1. Why do you want to join Nvidia?
  2. What is your experience with Deep learning? Tell me one thing you learned the hard way.
  3. What would you check first if a model's accuracy dropped after going live?
  4. When would you not use machine learning for a problem?
  5. Walk me through a model you built, from the data to how it was used.

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Senior Solutions Architect – Large Scale AI Training at Nvidia interview free →

We are looking for a senior Solutions Architect with strong knowledge of large-scale distributed training and Alignment of Neural Networks. The position involves supporting top EMEA AI Natives and research institutions in training/post training AI models, such as large Mixture-of-Experts (MoE) models. In this role, you will be the primary technical expert for AI organizations looking at some of the hardest infrastructure and algorithmic challenges in model training and alignment. You will bridge research and engineering, guiding customers on NVIDIA's full training stack (including Nemotron) while crafting NVIDIA product roadmap based on customers' feedback. What you'll be doing: Build and manage strategic technical relationship with leading EMEA AI model builders developing large-scale foundation models. Collaborate closely with customers to define the software stack and infrastructure required for large-scale training and post-training workflows, including Reinforcement Learning (RL). Serve as the go-to expert on distributed training strategies, guiding customers through efficient large-scale training and post training recipes using Deep Learning Frameworks such as PyTorch, Megatron-LM or NeMo (RL/Gym). Help customers optimize training/finetuning efficiency at scale, covering GPU utilization, communication overlap, memory management at scale. Collaborate with NVIDIA's product and research teams to present customer needs. Animate the developer community by building or supporting hackathons, demos, technical conferences. What we need to see: MS or PhD in Computer Science, Engineering, or equivalent experience. Over 7 years of practical experience in distributed AI training, including direct involvement with HPC and/or AI environments with multi-node GPU clusters. Solid understanding of training infrastructure and how it affects efficiency and scalability. Strong proficiency with Megatron-LM, NeMo, or equivalent distributed training frameworks. Excellent communication skills with an ability to engage both research scientists and infrastructure engineers. Ways to stand out from the crowd: Experience in fine-tuning with Reinforcement Learning (RLVR, RLHF) at scale. Experience with LatentMoE, expert load balancing, and speculative decoding for MoE inference. Prior experience in an AI Datacenter/HPC center, national lab, or frontier AI lab environment. Published work or open-source contributions in distributed training. Widely considered to be one of the technology world’s most desirable employers, NVIDIA offers highly competitive salaries and a comprehensive benefits package. As you plan your future, see what we can offer www.nvidiabenefits.com/ NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law. Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. For Poland: The base salary range is 292,500 PLN - 507,000 PLN.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on workday · posted 2026-10-21. ApplySarthi collects openings and links to application pages; the role is advertised by Nvidia, not by us.