Software Engineer - AI Tooling Infrastructure
Jobgether
Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.
Got this interview? Our apps help you get the job.
Skills named in this job
Read from the description itself, not inferred.
This role on the market
2,330 open infrastructure roles across 332 companies are on ApplySarthi right now, most of them in Bengaluru (126), Hyderabad (23), Delhi NCR (13).
- Capital Projects & Economics - ambito Transportation, Logistics and Infrastructure - Consultant | Milano [ADV]Pwc
- Senior DevOps and Infrastructure EngineerNvidia · pune
- Software Engineering PMTS - Backend Distributed Systems - Cloud InfrastructureSalesforce · hyderabad
- Infrastructure Architecture - Senior Professional IFiserv
- Software Engineering and Infrastructure Development - Team LeadStatestreet · bengaluru
What infrastructure roles keep asking for: AWS (31%), Python (29%), Observability (27%), System design (26%), Kubernetes (25%), CI/CD (19%), Linux (18%), Terraform (17%) — counted across their open postings here.
Remote Software Engineer jobs · CI/CD jobs · Docker jobs · Go jobs · LLMs jobs
Jobgether has 4,534 open roles listed here.
- 3D Artist (5-month contract)
- Account Executive (Inside Sales)
- Account Manager, Life Sciences
- Ad Monetisation Analyst
- Ad Monetisation Analyst
Counted across 14 company job boards, updated as roles open and close.
Preparing for this interview
Interviews for infrastructure roles keep coming back to AWS, Python, Observability, System design. Practise those questions before you sit with Jobgether.
Questions you are likely to be asked
- Why do you want to join Jobgether?
- What is your experience with Observability? Tell me one thing you learned the hard way.
- Tell me about a time the data was messy or wrong. What did you do?
- How would you explain your model's result to someone who is not technical?
- What would you check first if a model's accuracy dropped after going live?
Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.
Practise the Software Engineer - AI Tooling Infrastructure at Jobgether interview free →Accountabilities:: Build, deploy, operate, and scale production backend services supporting AI-powered developer tools, including MCP servers, agent skills, and AI assistants. Own service architecture and infrastructure decisions, improving system reliability, maintainability, scalability, and deployment processes. Define and monitor service reliability objectives (SLOs), track error budgets, and prioritize improvements in collaboration with Site Reliability Engineering (SRE) teams. Participate in the team's on-call rotation, investigate production incidents, coordinate resolutions, and develop incident reports, runbooks, and preventive solutions. Manage operational support requests and identify recurring issues that can be addressed through long-term engineering improvements. Design and maintain authentication and authorization systems for AI agents and machine clients, including OAuth applications, scoped tokens, permissions, and secure access management. Establish and maintain comprehensive observability through metrics, distributed tracing, logging, dashboards, and alerting systems. Manage AI agent traffic, implementing rate limits, capacity controls, cost safeguards, and mechanisms to handle dependency failures and unexpected traffic spikes. Collaborate with Platform, SRE, Authentication, Billing, and Edge Functions teams to improve shared infrastructure, release processes, security, and operational practices. Contribute to the development of AI tooling infrastructure, ensuring that reliability, security, and performance remain central to engineering decisions. Requirements: At least 5 years of experience building, deploying, and operating production backend services, including participation in on-call rotations. Strong programming skills in TypeScript or Go, with practical working knowledge of the other language. Proven experience designing and maintaining APIs, including versioning, error handling, rate limiting, and backward compatibility. Strong understanding of OAuth, OpenID Connect (OIDC), JWT, and API authorization, with the ability to troubleshoot authentication and permission issues in production environments. Good knowledge of PostgreSQL and relational database systems. Experience with CI/CD pipelines, Docker, containerized deployments, and Infrastructure as Code (IaC). Ability to troubleshoot distributed systems using metrics, logs, and traces to identify performance bottlenecks and service failures. Strong written and verbal communication skills, with the ability to collaborate across teams and work effectively in globally distributed, asynchronous environments. Adaptability, ownership, and the ability to navigate ambiguity while delivering solutions in fast-paced engineering environments. Deep expertise in at least one of the following areas: APIs and Authentication: Experience designing permission models, token scopes, and OAuth flows for third-party integrations or machine clients, including safely migrating authentication systems without disrupting existing users. Production Operations: Hands-on experience managing production services, participating in on-call rotations, developing alerts and runbooks, implementing SLOs, and improving system reliability. Gateways and Distributed Systems: Experience building or operating proxies, gateways, or distributed services, troubleshooting retries, partial failures, upstream outages, and making appropriate fail-open or fail-closed decisions under degraded conditions. Nice to have: Experience with AI agent tooling, Model Context Protocol (MCP), or infrastructure serving AI agents and LLM clients. Experience extracting services from larger codebases while maintaining compatibility with existing integrations. Familiarity with observability platforms such as Grafana, OpenTelemetry, or Logflare, along with practical experience implementing SLOs. Contributions to open-source projects, particularly within the Node.js, Go, TypeScript, or API tooling ecosystems. Benefits: Fully Remote: Work from anywhere in the world, with no office attendance requirements. Co-working Allowance: Access to a WeWork membership or co-working budget to support your preferred working environment. Equity Ownership: Employee Stock Option Plan (ESOP), giving every team member an opportunity to share in the company's long-term growth. Technology Allowance: Dedicated budget for professional equipment, including laptops, monitors, headphones, and other work essentials. Health Insurance: 100% health insurance coverage for employees and 80% coverage for dependents, regardless of location. Annual Company Off-sites: Opportunities to connect and collaborate with colleagues during a company-wide gathering in a different city each year. Flexible Working Arrangements: Asynchronous work culture with flexibility to organize your schedule and manage your responsibilities independently. Professional Development: Annual learning and education allowance for courses, books, conferences, and other career development opportunities. Global Collaboration: Join an international, remote-first engineering team working across more than 60 countries and 20 languages.
Match this job to your CV
ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.
Check my match →Similar open roles
- AI Trainers Network - MalteseJobgether
- AI Video EditorJobgether
- AI Trainers Network - GreekJobgether
- AI Architect / AI engineering leadJobgether
- AI Trainers Network - EnglishJobgether
- Artificial Intelligence (AI) TechnicianJobgether
- Analytical Chemistry Specialist - Freelance AI Trainer ProjectJobgether
- AI Trainers Network - ArabicJobgether
Need answers during your interview? Try Live Sarthi.
Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.
- Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
- Answers start in about 1.5 secondsResponse time varies with your connection and model.
- From your own CVYour projects and your experience, not a generic script.
- 30 minutes freeThen ₹99 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.
A Windows app, from the same team as ApplySarthi.
Listed on lever · posted 2026-11-02. ApplySarthi collects openings and links to application pages; the role is advertised by Jobgether, not by us.