Software Engineer, AI Gateway

Vercel

Hybrid - San Francisco
Hybrid
Posted 2026-02-12

Tailor my CV for this job, free View job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Prep SarthiFree 7-min demoPractise this interview with an AI interviewer, out loud.Unlimited mocks · $9.99/month →Live Sarthi30 min free demoAnswer hints during the real call, hidden from supported screen sharing.Unlimited interviews · $9.99/2 days · Windows →

Skills named in this job

JavaScript
System design
TypeScript

Read from the description itself, not inferred.

This role on the market

15,344 open software roles across 1,210 companies are on ApplySarthi right now, most of them in Bengaluru (921), Hyderabad (309), Pune (181).

Senior Software Development Engineer, BackendJobgether
Software Development Manager, AWS OpenSearchAmazon

What software roles keep asking for: Python (37%), Java (30%), AWS (29%), System design (26%), C++ (26%), CI/CD (23%), Observability (22%), Kubernetes (20%) — counted across their open postings here.

Software Engineer jobs in the United States · Software Engineer jobs in San Francisco · Remote Software Engineer jobs · JavaScript jobs · TypeScript jobs

Vercel has 87 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for software roles keep coming back to Python, Java, AWS, System design. Practise those questions before you sit with Vercel.

Questions you are likely to be asked

Why do you want to join Vercel?
What is your experience with JavaScript? Tell me one thing you learned the hard way.
Tell me about a time the data was messy or wrong. What did you do?
How would you explain your model's result to someone who is not technical?
What would you check first if a model's accuracy dropped after going live?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Software Engineer, AI Gateway at Vercel interview free →

About Vercel:

Vercel is the agentic infrastructure company, freeing people and agents to ship what's next. For more than a decade we've helped builders move from idea to production with speed, security, and exceptional developer experience.

Now we're scaling our products for both agents and people to ship and run software, built in the open and trusted by OpenAI, PayPal, Ramp, Supreme, and millions of developers worldwide.

About the role

As a member of the AI Gateway Team, you will be responsible for developing and enhancing our AI Gateway platform, which provides a unified API for accessing hundreds of AI models from multiple providers. You will collaborate with a remote and distributed team of engineers to build reliable, low-latency systems that handle rate limiting, intelligent failovers, and seamless integrations, enabling developers to ship AI-powered applications without managing provider-specific complexities. This role focuses on ensuring production-ready reliability for AI workloads, including automatic fallbacks during outages and consistent performance across providers like OpenAI, Anthropic, Google, and more.

What you'll do

Contribute to the design, implementation, and maintenance of the AI Gateway platform, emphasizing features like unified API endpoints, rate limit management, and intelligent failover mechanisms to boost uptime and reliability.
Write clean, efficient, and well-documented code, conducting thorough testing to ensure low-latency responses and stability for high-volume AI inference requests.
Collaborate with cross-functional teams, including product managers, AI researchers, and infrastructure engineers, to integrate new AI providers and models while addressing scalability and performance challenges.
Engage with the open-source community, contribute to AI SDK and related projects, and align with Vercel's ethos of fostering developer tools.
Gather user feedback and analytics to drive innovations in AI Gateway, such as enhanced billing unification, provider-agnostic authentication, and analytics for usage insights.

What you need

5+ years of relevant experience
Strong proficiency in JavaScript/TypeScript and experience with backend development, APIs, and cloud infrastructure
Experience with AI/ML integrations, API gateways, distributed systems, or handling high-throughput services (e.g., rate limiting, caching, failovers)
Experience contributing to or participating in open source projects
Excellent communication skills and the ability to work effectively in a collaborative team environment

Benefits & Compensation:

Competitive compensation package, including equity.
Inclusive Healthcare Package.
Learn and Grow - we provide mentorship and send you to events that help you build your network and skills.
Flexible Time Off.
We will provide you the gear you need to do your role, and a WFH budget for you to outfit your space as needed.

The San Francisco, CA base pay range for this role is $196,000-$294,000. Actual salary will be based on job-related skills, experience, and location. Compensation outside of San Francisco may be adjusted based on employee location. The total compensation package may include benefits, equity-based compensation, and eligibility for a company bonus or variable pay program depending on the role. Your recruiter can share more details during the hiring process.

#LI-KR1

Disclosures:

Privacy: Please review our Job Applicant Privacy Policy for more information on how we handle your data.
Equal Opportunity: Vercel is committed to fostering and empowering an inclusive community within our organization. We do not discriminate on the basis of race, religion, color, gender expression or identity, sexual orientation, national origin, citizenship, age, marital status, veteran status, disability status, or any other characteristic protected by law. Vercel encourages everyone to apply for our available positions, even if they don't necessarily check every box on the job description.

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Hidden from supported screen sharingThe overlay stays out of supported Windows screen captures.
Answers start in about 1.5 secondsResponse time varies with your connection and model.
From your own CVYour projects and your experience, not a generic script.
30 minutes freeThen ₹149 for a 2-day pass with unlimited calls — you pay for the days you are interviewing, not a subscription.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on greenhouse · posted 2026-02-12. ApplySarthi collects openings and links to application pages; the role is advertised by Vercel, not by us.