ApplySarthiSenior Technical Product Manager - AI Compute Platform
Nebius
Make my CV for this job, freeView job and applyYour CV, rewritten for this role using only your real experience. Sign in with Google and upload your CV. Nothing to install.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
2,636 open platform roles across 401 companies are on ApplySarthi right now, most of them in Bengaluru (124), Hyderabad (43), Pune (32).
- Senior Staff Software Engineer - Data Platform - Kubernetes - Distributed Systems - FederalServiceNow
- Data Engineer / Platform Engineer mit Expertise in Databricks (m/w/d) | Join our Talent Pool - SwitzerlandCallista Group AG
- Machine Learning Platform EngineerBjak
- ML Data & Platform EngineerSpeechmatics
- Platform DeveloperBLP Digital AG
What platform roles keep asking for: AWS (30%), Kubernetes (29%), Python (24%), Observability (23%), GCP (21%), System design (20%), Azure (19%), CI/CD (17%) — counted across their open postings here.
Remote Technical Product Manager jobs · AWS jobs · Azure jobs · GCP jobs · IAM jobs
Nebius has 384 open roles listed here.
- Senior Research Scientist (Architectures Research)
- Senior Hypervisor Engineer
- Senior HPC Cluster Engineer
- Senior Manager, SEO & GEO
- Sr. Technical Program Manager
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for platform roles keep coming back to AWS, Kubernetes, Python, Observability. Practise those questions before you sit with Nebius.
Questions you are likely to be asked
- Why do you want to join Nebius?
- What is your experience with Observability? Tell me one thing you learned the hard way.
- When would you not use machine learning for a problem?
- Walk me through a model you built, from the data to how it was used.
- How did you know your model was actually good, and not just good on your test set?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Senior Technical Product Manager - AI Compute Platform at Nebius interview free →About Nebius:
Nebius is leading a new era in cloud infrastructure for the global AI economy. We are building a full-stack AI cloud platform that supports developers and enterprises from data and model training through to production deployment, without the cost and complexity of building large in-house AI/ML infrastructure.
Built by engineers, for engineers. From large-scale GPU orchestration to inference optimization, we own the hard problems across compute, storage, networking and applied AI.
Listed on Nasdaq (NBIS) and headquartered in Amsterdam, we have a global footprint with R&D hubs across Europe, the UK, North America and Israel. Our team of 1,500+ includes hundreds of engineers with deep expertise across hardware, software and AI R&D.
Our customers build the frontier of AI on top of Nebius — training state-of-the-art models, running production inference at scale, shipping the research and products that define where the field is going next.
We are building the AI cloud that the people building the frontier of AI choose deliberately — not on price, not on raw capacity, but on how it works to use it day to day. To do that, we are growing the AI Compute Platform product team and hiring multiple Technical Product Managers across the full surface of the platform.
Your scope will be defined by what you bring. We will match your technical strengths, customer experience, and product instincts to the area of the platform where you can have the most impact. The platform is broad — and at our scale, every slice is mission-critical.
If you want to help build the best AI cloud in the world — and you have the technical depth to engage engineering leaders as a peer (not as a translator) and the comfort to talk to customers directly — this team is for you.
The platform you'll help build:
- Hardware platforms & launch — bringing new GPU and CPU platforms (GB300, Vera Rubin, ARM/Grace, future generations) to production with full launch readiness across the stack.
- Cluster lifecycle & fleet operations — new region launches, 100,000+ GPU cluster bring-up, platform sharding and allocation architecture, release engineering, host-lifecycle automation, operational efficiency.
- Reliability & Mission Control — autohealing, health checks, SLA, fault-tolerant training, MTTR reduction, customer trust at scale, observability as a product.
- Customer experience & developer surface — Compute APIs, console, CLI, IMDS and in-VM signals, self-service workflows, notifications, customer-facing observability, unified UX across the product line.
- GPU & InfiniBand foundational services — drivers, firmware, NCCL, IB/RoCE, NVLink topology, the foundational layer everything else builds on.
- Managed runtime platforms — Soperator (Slurm-on-Kubernetes) and MK8S (Managed Kubernetes for AI workloads), powering training and inference for frontier labs.
- Platform integrations & emerging workloads — Token Factory integration, RL and agentic workload infrastructure, capacity sharing, new business surfaces as they emerge.
- Cross-platform program & delivery — NVIDIA partnership programs, major-maintenance orchestration, cross-stream releases.
Your responsibilities will include (regardless of which slice you own):
- Own end-to-end product responsibility for your area — strategy, roadmap, discovery, delivery, adoption, measurable customer and platform outcomes.
- Design and own the platform contracts customers depend on — APIs, semantics, system events, customer-facing surfaces, operational behavior — at hyperscaler quality.
- Drive cross-team execution across platform engineering, networking, storage, Soperator/MK8S, observability, IAM, billing, capacity planning, support, and product design.
- Turn customer pain into product commitments through structured discovery — interviews, usage analytics, support patterns, incident postmortems. Close the loop so the same class of failure or friction does not recur.
- Engage engineering as a technical peer — debate API design, reason about system trade-offs, judge the quality of platform internals, and push back when the design is wrong.
- Define and own success metrics — what you ship is measured by what changed for the customer or the platform, not by the size of the spec.
- Be the product voice that customer-facing teams (Support, CX, TAMs) escalate to when a system behavior, API contract, or operational pattern needs a product decision, not a workaround.
- 6+ years in Product Management, Platform PM, Infrastructure PM, or SRE / Engineering Lead with strong product instincts.
- Strong technical foundation and cloud-infrastructure depth — comfort reasoning about API semantics, control-plane vs data-plane behavior, system events and lifecycle, multi-tenant operational realities. You can engage engineering leaders as a peer, not as a translator.
- Experience with cloud, GPU, or HPC infrastructure — either building one or operating one at meaningful scale (thousands of nodes, multi-region, multi-tenant).
- Track record of shipping technically complex platform products with measurable customer or platform impact — quantitative results, not aspirational bullets.
- Strong analytical skills: comfort defining and instrumenting product metrics, working with telemetry, building data-informed roadmaps.
- Experience leading discovery-heavy work — structured customer interviews, usage analytics, support-ticket analysis — and turning insights into shipped product.
- Strong communication and ability to align engineering, SRE, customer-facing teams, and exec stakeholders.
- High ownership, bias to ship, comfort with messy operational reality, and the instinct to push back on engineering when the customer experience or platform quality would suffer.
Customer-facing experience and lived-it perspective:
- Direct PM experience with frontier AI customers — ML platform teams, MLOps engineers, training and inference at scale.
- Familiarity with Kubernetes, Slurm, or HPC environments from the user side, and ML training workflows.
- Hands-on experience with ML training and inference workflows — especially distributed training at scale (multi-node, multi-GPU; comfort with checkpointing, NCCL, fault-tolerant training, debugging large training jobs).
- Experience as a customer of AI cloud infrastructure at large scale — especially as part of an internal ML platform team that built and operated infrastructure for ML engineers inside your own company. If you have lived through what frustrates customers about clouds, you will know exactly what we are trying to fix.
- Direct experience with NVIDIA reference architectures (NVL72, SuperPOD, MGX, DGX) and the NVIDIA stack (drivers, CUDA, NCCL, DCGM).
- Familiarity with InfiniBand / RoCE fabrics, firmware lifecycle, topology-aware scheduling.
- Hands-on with GPU clusters or HPC fabrics at thousands-of-nodes scale.
- Background in Kubernetes lifecycle (CAPI, cluster upgrades, node-pool management) or Slurm at scale.
- Experience launching new cloud regions or data-center bring-ups end-to-end.
- Background in release engineering, change management, or major-maintenance orchestration in production environments.
- Exposure to console / CLI / API design at hyperscaler quality — AWS, GCP, Azure depth on consistency, versioning, idempotency, error semantics, deprecation policy.
- Background in observability product — Grafana, Datadog, Honeycomb, New Relic.
- Knowledge of customer trust artefacts — status pages, RCA workflows, audit logs, SLA reporting, maintenance notifications.
- Familiarity with developer-experience product patterns — Stripe, Cloudflare, Vercel, Supabase, Render.
- Background in SRE, reliability engineering, or fault-tolerant systems for paying customers.
- Familiarity with reliability metrics that matter: Goodput, MFU, MTTR, MTBF.
- Experience with autohealing systems and graceful failure semantics.
- Familiarity with RL / agentic / inference workload patterns — vLLM, SGLang, Ray, Token Factory-style serving, sandbox technologies (Firecracker, gVisor, Kata).
- Experience with multi-product cloud integrations — capacity sharing, billing models, cross-product packaging.
- Background in pricing strategy for infrastructure products (reserved / on-demand / preemptible tiers, two-part pricing).
Benefits & Perks:
- Competitive compensation
- Career growth and learning opportunities
- Flexibility and ownership
- Collaborative and innovative culture
- Opportunity to work on impactful AI projects
- International environment and talented teams
What's it like to work at Nebius:
Fast moving - Bold thinking - Constant growth - Meaningful impact - Trust and real ownership - Opportunity to shape the future of AI
Equal Opportunity Statement:
Nebius is an equal opportunity employer. We are committed to fostering an inclusive and diverse workplace and to providing equal employment opportunities in all aspects of employment. We do not discriminate on the basis of race, color, religion, sex (including pregnancy), national origin, ancestry, age, disability, genetic information, marital status, veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by applicable law.
Applicants must be authorized to work in the country in which they apply and will be required to provide proof of employment eligibility as a condition of hire.
If you need accommodations during the application process, please let us know.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- Cloud Solution Architect - Educational Content Author, Nebius AcademyNebius
- Data Center Design LeadNebius
- Data Center - Electrical Design EngineerNebius
- Senior Data EngineerNebius
- Detection Engineering & Response EngineerNebius
- Director, PricingNebius
- Director, Solutions Architecture EMEANebius
- Educational Content Author - Cloud Solution Architect, Nebius AcademyNebius
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹99 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on greenhouse · posted 2026-06-17. ApplySarthi collects openings and links to application pages; the role is advertised by Nebius, not by us.