Senior Backend Engineer: Machine Learning Infrastructure
Jobgether
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
2,049 open infrastructure roles across 259 companies are on ApplySarthi right now, most of them in Bengaluru (66), Hyderabad (25), Mumbai (12).
- Technical Program Manager - Physical Infrastructure, Data Center Delivery, TIPM DCD qualification TeamAmazon
- Security Consultant-Infrastructure SecurityIBM
- Senior Core Infrastructure Engineer - OCI Product Catalog (Nashville-TN)Oracle
- Structural Health Monitoring & Critical Infrastructure EngineerHypotenuse Analytics
- DC Operations Manager - Critical InfrastructureNebius
What infrastructure roles keep asking for: AWS (30%), Python (23%), Kubernetes (22%), System design (22%), Observability (20%), Terraform (16%), CI/CD (14%), GCP (12%) — counted across their open postings here.
Remote Backend Engineer jobs · AWS jobs · Azure jobs · C++ jobs · Elasticsearch jobs
Jobgether has 4,574 open roles listed here.
- Account Director
- Account Executive (Multi-Product)
- Account Manager (Email Marketing)
- Account Manager (Email Marketing)
- Account Manager (Email Marketing)
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for infrastructure roles keep coming back to AWS, Python, Kubernetes, System design. Practise those questions before you sit with Jobgether.
Questions you are likely to be asked
- Why do you want to join Jobgether?
- What is your experience with Machine learning? Tell me one thing you learned the hard way.
- When would you not use machine learning for a problem?
- Walk me through a model you built, from the data to how it was used.
- How did you know your model was actually good, and not just good on your test set?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Senior Backend Engineer: Machine Learning Infrastructure at Jobgether interview free →Accountabilities: Design, build, deploy, and operate high-load distributed backend services and APIs that support machine learning infrastructure. Take end-to-end ownership of core ML services and associated data pipelines, from system design and implementation through deployment, observability, maintenance, and continuous improvement. Build reliable, scalable, and reusable infrastructure components that make machine learning workloads easier for product and ML teams to run and operate. Partner closely with ML and product engineers to understand their requirements and translate them into effective platform capabilities and services. Make and communicate technical decisions by evaluating architectural options, trade-offs, scalability, reliability, and operational requirements. Maintain a high standard for service reliability, performance, observability, and maintainability. Proactively identify technical and operational problems and take ownership of resolving them rather than allowing issues to remain unaddressed. Use modern AI-assisted development tools thoughtfully while maintaining strong ownership of system design, engineering decisions, and code quality. Contribute to a collaborative engineering culture by sharing knowledge, supporting teammates, and helping others solve technical challenges. Requirements 5+ years of professional experience in backend engineering, platform engineering, or a closely related discipline. Extensive professional experience with Python, the primary programming language used in the environment. Hands-on experience developing and operating software on a public cloud platform such as AWS, GCP, or Azure, or working with self-managed Kubernetes; experience with AWS is particularly relevant. Strong experience designing and building distributed, high-load services and APIs. Solid understanding of data structures, algorithms, and the trade-offs involved in selecting and implementing them. Strong system-design mindset, with the ability to design solutions before implementation and understand the architectural implications of technical decisions. Experience working effectively with modern AI-assisted coding and development tools, combined with the judgment to understand their appropriate use and limitations. High level of ownership, initiative, and accountability, with a proactive approach to identifying and solving problems. Strong communication and collaboration skills, with a friendly and supportive approach to working with teammates and cross-functional partners. Experience with Rust, C, C++, or Go is a strong advantage. Previous experience developing or contributing to ML platforms or machine learning infrastructure is highly valued. Experience setting up and operating vector databases such as Qdrant, Milvus, Weaviate, OpenSearch, or pgvector is a plus. Experience with model serving or inference infrastructure, including LLM workloads, is advantageous. Experience with Infrastructure as Code tools such as Terraform is a plus. Benefits Fully remote working environment, allowing you to choose where you live. Unlimited vacation time, with employees strongly encouraged to take at least three weeks of vacation each year. Home-office stipend to help you create a productive and comfortable remote workspace. Apple laptop provided for new employees. Annual training and professional development budget. Maternity and paternity leave for eligible employees. Competitive base salary of $80,000–$120,000 USD , depending on knowledge, skills, experience, and interview results. Stock options offered in addition to the base salary. Regular team offsites providing opportunities for collaboration and connection. Opportunity to work with experienced colleagues and contribute to meaningful, technically challenging projects.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend)Jobgether
- (Senior) Product Engineer (Backend) (m/f/d)Jobgether
- (Senior) Product Engineer (Backend) (m/f/d)Jobgether
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹99 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on lever · posted 2026-09-30. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.