ApplySarthi

Lead Software Engineer- AI Agent Developer

JPMorgan

Tailor my CV for this job, freeView job and applyYour CV rewritten for this role, from your real experience. Sign in with Google, nothing to install.

Got this interview? Our apps help you get the job.

Skills named in this job

Read from the description itself, not inferred.

This role on the market

13,636 open software roles across 1,104 companies are on ApplySarthi right now, most of them in Bengaluru (883), Hyderabad (290), Pune (179).

What software roles keep asking for: Python (37%), Java (30%), AWS (29%), System design (27%), C++ (24%), CI/CD (23%), Observability (23%), Kubernetes (20%) — counted across their open postings here.

Go jobs · Java jobs · LLMs jobs · Observability jobs

JPMorgan has 7,112 open roles listed here.

Counted across 14 company job boards, updated as roles open and close.

Preparing for this interview

Interviews for software roles keep coming back to Python, Java, AWS, System design. Practise those questions before you sit with JPMorgan.

Questions you are likely to be asked

  1. Why do you want to join JPMorgan?
  2. What is your experience with LLMs? Tell me one thing you learned the hard way.
  3. When would you not use machine learning for a problem?
  4. Walk me through a model you built, from the data to how it was used.
  5. How did you know your model was actually good, and not just good on your test set?

Prep Sarthi gives you a free mock interview: an AI interviewer asks you questions like these out loud, from your own CV and this job, and shows your score and your weakest answer.

Practise the Lead Software Engineer- AI Agent Developer at JPMorgan interview free →

Join us to advance your software engineering career while building impactful technology solutions. Grow your skills and make a difference with a collaborative team. We’re seeking a Lead Software Engineer (AI/ML) to build and operate scalable, low-latency autonomous agent systems in production. You’ll lead the design and delivery of agentic platforms that reliably serve 100K+ customers, combining strong software engineering fundamentals with deep hands-on expertise in foundation models and LLM-powered architectures. Job responsibilities Architect and ship autonomous agent systems that are scalable, resilient, and production-grade (latency, reliability, security, and uptime). Design agentic architectures (planner/executor patterns, multi-agent orchestration, tool use, retrieval, and workflow execution). Build robust tool interfaces and tool ecosystems (APIs, function calling patterns, permissions, and safe execution). Engineer context, memory, and state management strategies (short/long-term memory, summarization, retrieval, grounding, and caching). Own model evaluation and quality measurement (offline/online evals, regression testing, and failure-mode analysis). Implement end-to-end observability for LLM systems (tracing, metrics, logging, prompt/tool telemetry, incident response). Drive cost and performance optimization across models and infrastructure (throughput, batching, caching, routing, quantization, and inference efficiency). Mentor engineers and set engineering standards for production AI systems (code quality, design reviews, and operational excellence). Required qualifications, capabilities and skills 8+ years of software engineering experience, including leading design and delivery of large-scale production systems. Demonstrated experience building and operating LLM/agentic systems in production with strict latency and reliability requirements. Strong understanding of foundation models, LLM behavior, prompting strategies, and tool-augmented generation patterns. Strong understanding of Knowledge graph (Neo4J preferred), Open Knowledge formats (OKFs) Proven expertise in context and memory engineering, model evaluation methodologies, and quality measurement. Experience implementing observability for distributed systems and AI applications (tracing/metrics/logs, dashboards, alerting, on-call readiness). Strong programming skills in one or more of: Python, Java, Go, or TypeScript; plus strong API and distributed-systems fundamentals. Familiarity with retrieval systems, vector databases, and hybrid search patterns. Preferred qualifications, capabilities and skills Agentic AI architecture: planner/executor patterns, multi-agent orchestration, tool-use design, retrieval workflows LLM/foundation model expertise: prompting strategies, tool-augmented generation, model behavior understanding Context & memory engineering: short/long-term memory, summarization, retrieval grounding, caching strategies Knowledge graphs: Neo4J (preferred), Open Knowledge Formats (OKFs) Retrieval systems: vector databases, hybrid search patterns

Match this job to your CV

ApplySarthi scores your CV against this role, shows the skills you are missing, and writes a tailored version for the application.

Check my match →

Similar open roles

Need answers during your interview? Try Live Sarthi.

Live Sarthi, an Interview Sarthi app, shows answer suggestions during the call.

Try Live Sarthi free →

A Windows app, from the same team as ApplySarthi.

Listed on oraclehcm · posted 2026-11-03. ApplySarthi collects openings and links to application pages; the role is advertised by JPMorgan, not by us.